0%


title:好文收集

AI 新时代,大模型该如何“绞尽脑汁”?

本文主要讲述增强大模型推理思考的技术手段


开源大模型部署及推理所需显卡成本必读:也看大模型参数与显卡大小的大致映射策略开源大模型部署及推理所需显卡成本必读:也看大模型参数与显卡大小的大致映射策略

主要讲述关于大模型显卡内存的一些常识


人工神经网络实验的新理论:大脑可能通过评估记忆的有效性来指导其存储位置

大脑中不同的记忆处于不同的大脑位置中,大脑在进行记忆的储存时会根据记忆对未来的重要性而储存在不同的大脑位置中

每次回忆一次经历时,网络的连接权重都会发生变化,导致记忆元素更加平均。

神经网络是否也需要具备这样的特性,在每次单纯的输入也会造成网络参数的变化

大脑有两个相互关联、互补的学习系统:快速编码新信息的海马体和逐渐整合新信息以进行长期存储的新皮质。

对神经网络的启示?


ETH等提出思维图(GoT)超越思维链(CoT): 用LLMs解决复杂问题

GoT的关键思想和主要优势是能够将LLM生成的信息建模为任意图,其中信息单元(“LLM思维”)是顶点,边对应于这些顶点之间的依赖关系


通过大语言模型和人工智能的力量改变军事规划

本文探讨了 LLMs 在军事规划革命中的潜力,并强调了它们带来的挑战和机遇。


听我说,Transformer他就是个向量机

一篇来自宾夕法尼亚大学、加州大学河滨分校的论文试图研究大模型基础 Transformer 结构的原理,其在注意力层的优化几何与将最优输入 token 与非最优 token 分开的硬边界 SVM 问题之间建立了形式等价。


How to read code

  1. 忽略函数
  2. 简化重复代码

从零开始,大模型训练教程


transformers 总结和解释


GPT 是如何工作的:200 行 Python 代码实现一个极简 GPT

本文实际上是基于 PyTorch,并不是完全只用基础 Python 包实现一个 GPT。 主要目的是为了能让大家对 GPT 这样一个复杂系统的(不那么底层的)内部工作机制有个直观理解。


Transformer 是如何工作的

对Transformer讲的很详细,很好的文章


GPU架构和入门介绍


Transformers入门


4GB 显存单卡居然能跑 70B 大模型了

介绍了低显存允许大模型和微调大模型的两种方法

离线安装python库

第一步 在有网络的主机上下载库文件包

1
pip download -d ./path transformers==4.30.2

该命令将会把对应库及其依赖库的文件都下载到当其目录的path文件夹当中

然后将path文件夹上传到离线环境的主机下

第二步 在离线环境下安装path文件夹中的库

1
pip install --no-index --find-links=./path transformers

在离线环境下使用上述命令即可安装所需要的库

补充1 提示缺少某个库依赖

这种情况是因为有网的主机python环境下已经存在某个所需要的包,所以并没有将这个包下载到path文件中,而离线环境下没有这个包所导致的,这种情况 只需要对于这个没有的包 使用一下上面的流程就可以了

补充2 提示库的版本不对

这种情况是因为有网主机的python环境(操作系统, python版本)与离线主机的python环境不一致导致的, 需要找一个与离线主机python版本一致的主机即可.

离线安装conda库

你需要有什么?

  1. 迁出机器:可联网,已有虚拟环境准备迁移的机器,可以是本地电脑也可以是服务器
  2. 迁入机器:不可联网,无虚拟环境,可以是另一台电脑也可以是服务器

迁出机器部分——打包环境

迁出机器安装打包工具

1
conda install -c conda-forge conda-pack

安装好之后打包需要迁出的环境(-n 之后为 虚拟环境名字 -o 之后为打包出来的文件名)

1
conda pack -n envsname -o conda_envsname.tar.gz

gz是一个压缩文件,包含了你环境本身以及所有的包

将打包的环境通过 ftp 传输到迁入机器中

迁出机器部分结束

迁入机器部分——解压、部署环境

在你的 anaconda 目录下创建文件夹 名称(envs)即为你迁过来的环境名称

1
mkdir -p /root/anaconda3/envs/envsname

解压环境(-C 之前为打包压缩文件路径 -C 之后为迁入机器 anaconda3 文件夹下 envs 目录 + 环境名)

1
tar -xzf /root/tempfile/conda_envsname.tar.gz -C /root/anaconda3/envs/envsname

执行后完成 cd 进 envs 目录中已经可以看到环境拷贝完成

1
/root/anaconda3/envs/envsname

检查环境是否完全复制

1
2
3
conda activate envsname
pip list
conda list

使用warp进行校园网免流

目录

  1. 1. 如何配置
  2. 2. 关于手机客户端
  3. 3. 关于实现PC端只连接ipv6入口(免流)
  4. 4. 关于速度
  5. 5. 关于延迟
  6. 6. 关于是否需要warp+
  7. 7. 关于网站可用性

前排感谢cloudflare提供的免费代理。

另外,不知道什么原因 23.7.20补充:hk和中国代理节点限制了wg直连 ,warp导出的配置在wireguard里面用不了,但是用客户端没问题。

如何配置(仅windows)

warp用起来很简单,上tg找个代刷 warp+ 账号的Bot。我用的是 @generatewarpplusbot ,输入 /generate 然后回答一个两位数加减法就可以获取一个剩余流量 22PB 的warp+的key,足够用到天荒地老了。

客户端的话要去1.1.1.1的官网下载。Windows,Mac,Linux,Android,IOS都有对应的客户端,官网在家宽下条件下被墙,需要科学上网。另外,Android的warp不能代理一些流媒体软件,比如说Youtube,其它平台的客户端没有这个问题。不过在安卓上使用浏览器还是可以看YouTube网页版的。

warp安装之后默认是普通账户。在电脑上,点击右下角的warp图标(截图是warp+的原因是我懒得退账号了)

点击齿轮左边像甲虫的按钮

输入机器人发送的密钥。现在就可以使用warp+的流量了。

关于手机客户端

试了一下,Android的客户端在校园网环境下无法直接连上warp+,需要先在科学上网的网络环境下先连接一次才可以连接,而且不支持纯ipv6的连接。但是ZeroTrust可以正常连接。(相当于无限流量的企业版warp+,也免费,但是需要绑一下付款方式,支持Paypal,并且可以通过一些手段绕过)

23.7.20更新:不知为何安卓端最近无法在校园网未登录情况下使用ZeroTrust免流。但是iPad和PC上使用正常。

关于实现PC端只连接ipv6入口(免流)

开发区校区的校园网不登录即可实现免流。已登录的可以到这个页面登出。

校部的校园网需要额外配置Cf对端IP类型为IPv6,请参考优选IP教程

盘锦校区没有条件测试,但是应该也可以参考实现。

Linux系统下

客户端的话要去1.1.1.1的官网下载,下载得到的软件是跟window不太一样的,linux下必须要登陆teams,所以需要去cloudfare申请免费plan的账户,申请账户需要用到信用卡(可以用paypal),paypal帐号申请可以使用国内的银行卡,所以只要有国内银行卡就可以申请一个免费plan的cloudfare账户.

之后就可以登陆Linux下的cloudfare-warp

image-20231201180118189

登陆之后就可以访问外网,但是如果想要配置ipv6还需要从命令行输入命令

首先使用github上提供的脚本获取可用的ipv6可用ip

1
wget -N https://gitlab.com/Misaka-blog/warp-script/-/raw/main/files/warp-yxip/warp-yxip.sh && bash warp-yxip.sh

获得可用的ipv6 ip地址后.通过下面的命令设置

1
2
sudo warp-cli clear-custom-endpoint
sudo warp-cli set-custom-endpoint [上面获得的ipv6的地址]

Linux的问题

  1. Linux下无法使用更换密钥的方式使用

关于速度

实测校园网环境网页版Youtube开启4K画质无压力。

7.20补充:300M电信宽带下实测带宽可以达到40M,可以在ios端原速流畅观看YouTube 1080p60的视频。

关于延迟

打游戏的话,试了试瓦,会定到港服,延迟在60ms左右,可以说是非常优秀了,毕竟不要钱。

5.14补充:晚上使用的话丢包会比较严重,对枪存在可感的延迟。

关于是否需要warp+

实测有无warp+或zerotrust对于代理的速度没有显著影响,但据说访问使用Cloudflare作为CDN的网站时,会提供加速功能并消耗流量。

关于网站可用性

ChatGPT可以正常登录和使用 更新:单纯使用warp已经无法解锁ChatGPT。似乎大部分的流媒体网站都可用。

目录

作为一名科研人员,也许你经常会在不同类型的论文中看到各种令人称赞的算法框图或者神经网络框图,作为一名AI从业者,你经常需要在你的论文、Poster或者Slide中添加一些神经网络框图,作为新手的我也经常遇到这个问题,但是一直并没有找到一个好的工具,很多大佬们都说利用PPT或者Visio等就能绘制成功,我的想法是这样的,尽管很多工具都能完成同样的一项工作,但是它们的效果和效率肯定是不一样的,你用Visio需要2个小时的一张图或者利用另外的一个工具仅仅需要花费20分钟,这可能就是所谓的区别,如果你感觉你的时间很多,浪费一点无所谓,请高手们绕过这篇博文。我花费了一点时间在网上找了很多有用的工具,在这里总结汇总一下,朋友们各取所好!

1. LaTeX的tikz库

作为科研人员,你可能经常需要用Latex写一些论文,那么其中有一款支持LaTex的工具tikz可以用来绘制各种各样的图,这可能是最方便的工具了。下面是有关该库的一些学习资料。
1、TikZ的官网-http://www.texample.net/tikz/
2、LateX在线编辑工具-https://www.overleaf.com
3、TikZ快速入门文档-http://cremeronline.com/LaTeX/minimaltikz.pdf
tikz样例1
tikz样例2

2. ConvNetDraw

这个工具可能很多人都不知道,不过如果你知道神经网络的结构,而且你能很快的写出基本的代码,那么这款软件再方便不过啦,重要的是它的绘制结果是3D,比较好看,缺点是卷积层的颜色等比较固定,不适合进行设计。以下是有关该工具的几个有用链接。
1、ConvNetDraw的github-https://github.com/cbovar/ConvNetDraw
2、ConvNetDraw在线绘图网址-https://cbovar.github.io/ConvNetDraw/
ConvNetDraw样例1

3. Visio

这个软件可能很多人都使用过,我以前所有的图基本上都是用它完成的,它的确很强大,值得去推荐,但是我总想去寻找一个更优的工具。以下是使用Visio绘制的几张神经网络图。这个软件可能很多人都使用过,我以前所有的图基本上都是用它完成的,它的确很强大,值得去推荐,但是我总想去寻找一个更优的工具。以下是使用Visio绘制的几张神经网络图。
Visio样例1
Visio样例2

4. Inkscape-自由绘图

这个软件是一个类似Visio的软件,功能比较齐全,可以完成各种各样的图,不过我一直没有去尝试过。下面是有关该软件的一些有用链接。这个软件是一个雷士Visio的软件,功能比较齐全,可以完成各种各样的图,不过我一直没有去尝试过。下面是有关该软件的一些有用链接。
1、Inkscape官网-https://inkscape.org/zh/
2、Inkscape教程-https://inkscape.org/zh/learn/tutorials/
在这里插入图片描述

5. Omnigraffle

它是由The Omni Group制作的一款绘图软件,其只能于运行在Mac OS X和iPad平台之上,添加公式可以配合latexit使用。可以用来绘制图表,流程图,组织结构图以及插图,也可以用来组织头脑中思考的信息,组织头脑风暴的结果,绘制心智图,作为样式管理器,或设计网页或PDF文档的原型。嵌入在论文里导出成pdf,嵌入在网页里导出成svg。十分方便。由The Omni Group制作的一款绘图软件,其只能于运行在Mac OS X和iPad平台之上,添加公式可以配合latexit使用。可以用来绘制图表,流程图,组织结构图以及插图,也可以用来组织头脑中思考的信息,组织头脑风暴的结果,绘制心智图,作为样式管理器,或设计网页或PDF文档的原型。嵌入在论文里导出成pdf,嵌入在网页里导出成svg,十分方便。在这里插入图片描述
在这里插入图片描述

6. draw_convnet

这是一个Python工具,可以将代码转换为网络图显示出来。有关该工具的有用链接如下所示:
1、raw_convnet的github链接-https://github.com/gwding/draw\_convnet
在这里插入图片描述

7. PlotNeuralNet

这是我偶然间寻找到的工具,基于Latex,话不多说,直接看效果你就决定要不要使用它啦。其相关链接如下所示:
1、PlotNeuralNet的github链接-https://github.com/HarisIqbal88/PlotNeuralNet
PlotNeuralNet
在这里插入图片描述

8. NN-SVG

有关该软件的有用链接如下所示:
1、N-SVG的github链接-https://github.com/zfrenchee/NN-SVG
2、N-SVG的在线界面-http://alexlenail.me/NN-SVG/LeNet.html
在这里插入图片描述
在这里插入图片描述

9. Python + Graphviz

针对节点较多的网络,不可避免需要投入大量尽量来写重复的脚本代码。用python编写了一个简单的dot脚本生成工具(MakeNN),可以很方便的输入参数生成nn结构图。
在这里插入图片描述

10. Graphviz - dot

在dot里面label的玩法比较多,在上面看到的每个节点都是简单的一段文字,如果想要比较复杂的结构怎么办?那就通过编写代码生成吧。其对应的代码和结果如下所示。其相关的资源如下所示:
1、Graphviz的官方链接-https://www.graphviz.org/![在这里插入图片描述](https://img-blog.csdnimg.cn/20190222213956794.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L1daWjE4MTkxMTcxNjYx,size_16,color_FFFFFF,t_70#pic_center)
在这里插入图片描述

11. Keras

使用Keras框架(后端可选tensorflow或者theano),可以画出卷积神经网络的结构图。其相关资源如下所示:
1、keras英文文档-https://keras.io/
2、keras中文文档-https://keras.io/zh/
3、keras的github链接-https://github.com/keras-team/keras

1
2
3
4
5
6
from keras.layers import Input, Convolution2D, Flatten, Dense, Activationfrom keras.models import Sequentialfrom keras.optimizers import SGD , Adamfrom keras.initializations import normalfrom keras.utils.visualize_util import plot# apply a 3x3 convolution with 64 output filters on a 256x256 image:model = Sequential()
model.add(Convolution2D(64, 3, 3, border_mode='same', dim_ordering='th',input_shape=(3, 256, 256)))# now model.output_shape == (None, 64, 256, 256)# add a 3x3 convolution on top, with 32 output filters:model.add(Convolution2D(32, 3, 3, border_mode='same', dim_ordering='th'))# now model.output_shape == (None, 32, 256, 256)adam = Adam(lr=1e-6)
model.compile(loss='mse',optimizer=adam)
print("We finish building the model")

plot(model, to_file='model1.png', show_shapes=True)

在这里插入图片描述

12、Netscope

Netscope是个支持prototxt格式描述的神经网络结构的在线可视工具,专门针对神经网络框架caffe而言。该工具的有用资源如下所示:
1、Netscope文档链接- https://ethereon.github.io/netscope/quickstart.html
2、Netscope的github链接-https://github.com/ethereon/netscope
3、Netscope在线链接-http://ethereon.github.io/netscope/#/editor
使用说明:直接打开相应的.prototxt文件复制到左边的黑色区域,然后按下Shift+Enter即可获得可视化结果。
在这里插入图片描述

13. Caffe自带绘图工具

caffe源码中的tools文件夹下面有个draw_net.py文件。Python/draw_net.py, 这个文件,就是用来绘制网络模型的。也就是将网络模型由prototxt变成一张图片。 在这里插入图片描述

14. TensorBoard

这个工具也好用于,可以保存好多在训练网络过程中的中间结果,同时也可以可视化整个网络的架构。其相关的有用资源如下所示:
1、tensorboard文档-https://www.tensorflow.org/guide/summaries\_and\_tensorboard
2、tensorboardgithub-https://github.com/tensorflow/tensorboard 在这里插入图片描述

15. NetworkX

一个可以用来绘制神经网络的python包,其相应的资源如下所示:
1、NetworkX文档-https://networkx.github.io/documentation/latest/tutorial.html
2、NetworkX的github-https://github.com/networkx

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
>>> options = {
... 'node_color': 'black',
... 'node_size': 100,
... 'width': 3,
... }
>>> plt.subplot(221)
<matplotlib.axes._subplots.AxesSubplot object at ...>
>>> nx.draw_random(G, **options)
>>> plt.subplot(222)
<matplotlib.axes._subplots.AxesSubplot object at ...>
>>> nx.draw_circular(G, **options)
>>> plt.subplot(223)
<matplotlib.axes._subplots.AxesSubplot object at ...>
>>> nx.draw_spectral(G, **options)
>>> plt.subplot(224)
<matplotlib.axes._subplots.AxesSubplot object at ...>
>>> nx.draw_shell(G, nlist=[range(5,10), range(5)], **options)

在这里插入图片描述

16. Bokeh

Bokeh是一个交互式可视化库,面向现代Web浏览器进行演示。 它的目标是提供优雅,简洁的多功能图形构造,并通过非常大或流数据集的高性能交互来扩展此功能。 Bokeh可以帮助任何想要快速轻松地创建交互式图表,仪表板和数据应用程序的人。其相关资源链接如下所示:
1、Bokeh官网-https://bokeh.pydata.org/en/latest/
2、Bokeh文档-https://bokeh.pydata.org/en/latest/docs/user\_guide.html#userguide
在这里插入图片描述

17. DAFT

Daft是一个Python包,它使用matplotlib渲染像素完美的概率图形模型,以便在期刊或互联网上发布。 使用简短的Python脚本和直观的模型构建语法,您可以设计定向(贝叶斯网络,有向无环图)和无向(马尔可夫随机场)模型,并将它们保存为matplotlib支持的任何格式(包括PDF,PNG,EPS和SVG))。其相关资源如下所示:
1、daft官网链接-http://daft-pgm.org/
2、daft的github链接-https://github.com/dfm/daft
在这里插入图片描述

18. Netron

这是一款模型可视化神器,Netron supports ONNX (.onnx, .pb, .pbtxt), Keras (.h5, .keras), CoreML (.mlmodel), Caffe2(predict_net.pb, predict_net.pbtxt), MXNet (.model, -symbol.json) and TensorFlow Lite (.tflite). Netron has experimental support for Caffe (.caffemodel, .prototxt), PyTorch (.pth), Torch (.t7), CNTK(.model, .cntk), PaddlePaddle (model), Darknet (.cfg), scikit-learn (.pkl), TensorFlow.js(model.json, .pb) and TensorFlow (.pb, .meta, .pbtxt).你应该很惊讶吧,它就是这么厉害。有关资源如下所示:
1、Netron官网-https://electronjs.org/apps/netron
2、Netron的github-https://github.com/lutzroeder/netron
3、Netron的在线界面-https://lutzroeder.github.io/netron/
在这里插入图片描述

参考资料

1、https://datascience.stackexchange.com/questions/12851/how-do-you-visualize-neural-network-architectures
2、https://datascience.stackexchange.com/questions/14899/how-to-draw-deep-learning-network-architecture-diagrams
3、https://zhuanlan.zhihu.com/p/31920000
4、https://www.quora.com/What-tools-are-good-for-drawing-neural-network-architecture-diagrams

美军电磁频谱发展及现状

其最核心的理念,就是要把“扰乱敌人”和“管好自己”真正融为一体,最有效地运用电磁频谱这种无形资源, 通过夺取无形空间的优势,确保有形空间的优势。

当前美军的电磁频谱作战中,电磁频谱管理主要发挥规划和协调作用,即分配频谱资源,消除用频冲突,解决电磁干扰。

从技术层次来讲,电磁频谱作战更关注环境。电磁波同时具备电信号、磁信号、波函数、动量等特征。结合美军各军种近几年发展情况来看,在“低至零功率”理念牵引下,其电磁频谱战系统初步具备网络化、捷变化、小型化和多功能化等特征,同时具备自适应能力。****网络化即能够使用低截获概率/低探测概率数据链与相邻的电磁频谱战系统进行通信并协调行动,例如美国海军的“复仇女神”(NEMESIS)定向红外对抗项目,F-35的多功能先进数据链(MADL)。捷变化即能够在功率、频率、空间和时间域机动,保持不被探测、能瞄准敌方网络并规避对方对抗措施,例如EA-18G的“下一代干扰机”(NJG)、“水面电子战改进项目”(SEWIP)。多功能即能够实施多种电磁频谱战功能,开发单个电磁频谱战系统,每个系统能够履行通信、干扰、诱偏或照射目标功能,例如DAPRA的“相干发射反向天线阵”(ReACT)项目。小型化,是基于经济可承受程度提出的,即能够在小型无人装备和系统或大型平台上大量部署应用,从而形成多种电磁频谱战网络,例如近期提出的“小型空射诱饵”、“低成本无人机蜂群技术”(LOCUST)。而自适应性即能够表征电磁频谱特征,包括描述未知辐射源,并对其做出相应以利用时机或对抗敌方的电磁频谱行动,例如数字射频存储干扰机。上述技术支撑的电磁频谱战装备、系统已部分列入美军装备序列,或在近几年进行部署,下一阶段大概率会围绕“低至零功率”的传感器、通信和对抗措施展开竞争。但受制于需求分析繁琐、概念开发、官僚采办和碎片式采购的影响,在电磁频谱技术革新方面动作缓慢。

“电磁频谱作战”概念的条令化是在诸多相关概念的集成结果。美军认为转入新的电磁频谱战竞争模式首先需要配套的作战概念,以确定发展电磁频谱作战的优先级、条令和战术。一是前文讲到的“低至零功率”概念,目前各军种都在制定对应的作战概念和条令,优先部署“低至零功率”网络和对抗措施,能无源工作或以降低被敌人从电磁环境背景噪音中识别的方式工作。在此基础上,美军还拓展了“低至零功率”概念[9],以便更广泛地应用于联合部队以及各种任务和场景,例如利用无源或多基地探测发现敌方部队、利用反射定位敌方部队、在反介入/区域拒止包络中作战、保护己方部队不被探测攻击等。二是针对灰色地带研发“齐射对抗”等新概念和新能力,例如使用导弹、小型无人机和巡飞弹实现小规模、高精准齐射对抗,利用潜基平台发射电磁战设备进行小规模、高精准齐射对抗,对抗态势感知行动以在灰色地带对抗时提高齐射规模和作战等级。在此基础上,美军于2017年提出“马赛克战”概念[10],即利用大量侦察类、攻击类和电磁战类无人装备进行作战,而无人装备的控制协同高度依赖于战区电磁频谱控制能力,所以“马赛克战”概念也促进了电磁频谱战的发展。三是国防部和各军种开发或合作开发的作战概念,例如“分布式杀伤”概念、“多域作战”概念、“全域作战”概念和“联合全域指挥控制”概念等[11],其中的“分布式杀伤”概念促进了美国海军“下一代电子战”(ADVEW)系统的开发,而“全域作战”概念已经被其空军条令化,将电磁频谱增补为重要一域。

下一阶段大概率会围绕“低至零功率”的传感器、通信和对抗措施展开竞争。但受制于需求分析繁琐、概念开发、官僚采办和碎片式采购的影响,在电磁频谱技术革新方面动作缓慢。

美军更新电磁频谱战发展理念、发展动力和发展路线的根本是落脚点在于创新行动模式。近几年,美军提出印太战略,在电磁空间与我激烈交锋。鉴于其电磁频谱战能力建设持续推进,可以预见与中俄的电磁博弈将愈演愈烈。从美军近5年的一系列概念开发和建设发展来看,其电磁频谱战均聚焦“破解中俄‘反介入/区域拒止’挑战”以维持联合部队行动自由这一核心问题,通过实施融入体系的电磁频谱行动,实现远程震慑和“穿透式”作战。

一是诱迫地面防空雷达开机,实施态势侦察和火力消耗。即利用无人机蜂群中的诱饵和小型干扰器抵近侦扰,刺激敌方防空系统预警雷达、跟踪制导雷达开机进入战斗辐射状态。随后利用小型传感器监测敌方反应、探测形成电磁态势图、定位目标信息,并实时后传侦察信息。另外,还可以利用诱饵和小型无人装备消耗敌方防空系统火力。

二是在高烈度作战区域延伸通信、扩展感知。无人机蜂群中的诱饵和小型干扰器进入高竞争区域,在内部建立低截获通信网络,使攻击体系的通信网络有效延伸至“反介入/区域拒止”环境,抵消防御方拒止效果;小型传感器实施目标探测、定位,并依托延伸网络回传信息,通过抵近侦察感知,有效解决远距离探测方式对拒止区域内感知定位能力的不足问题。

三是为“齐射”火力开辟电磁通道、协同火力打击、实施效果评估。诱饵和小型干扰器迷茫或欺骗敌方防空系统传感器,并在齐射集群到达防御区域之前耗尽其防御火力。因而可以通过建立安全通道,掩护火力到达打击目标;无人机蜂群中的诱饵和小型干扰器处于打击最前沿,验证目标引导打击,并可为巡飞打击平台实时分配时敏目标,确保首先摧毁高优先级目标;为评估打击效果,在进攻武器的后面可以跟随一个波次无人机蜂群,感知目标是否已被摧毁,并可以利用上述的协同,直接指挥齐射中剩余的武器对未被充分削弱的目标再次进行打击,或为后续的齐射提供打击提示。

四是遂行“穿透型电子攻击”,为“穿透型制空”创造条件。无人机蜂群中的诱饵和小型干扰器在主战飞机之前核实对方防空系统的位置信息,并通过通信网络将这些信息传回主战飞机。干扰机和诱饵实施干扰,削弱对方防空系统传感器,降低对方防空火力密度。然后,主战飞机进入作战区域,齐射大型短程武器,摧毁地面目标。电磁频谱战蜂群实施的“穿透型电子攻击”,为大型空中攻击平台抵近目标、在防护密集区域遂行打击创造了条件,并且增加了空对地打击平台可携带武器数量。

五是反侦察探测,掩护地(海)面机动。组合使用诱饵、电子干扰和电子佯动,给对方创建一幅虚假的战场态势图,以保护地面部队在高威胁区域安全。采取辐射控制措施,降低被探测概率;使用低成本诱饵和伪装,具备模拟真实舰船、飞机或者地面部队的雷达和无线电信号的能力,以迟滞对方对己方的定位,或者迫使对方采取更大规模的齐射来同时攻击真实目标和诱饵目标;由无人地面载具、无人水面载具或无人机携带激光眩目或无线电干扰,实施反侦察。

image-20231002103643569

如何制胜未来电磁空间

美军提出认知电子战的作战概念后开展了广泛的作战试验。2016年,美国国防部高级研究计划局(DARPA)与洛克希德.马丁公司合作开发了“自适应雷达对抗”项目。该项目推出了首款认知雷达对抗系统原型机,依托机器学习算法动态侦察干扰目标雷达,并大幅缩短了信号分析的时间。此外,诸如自适应电子战行为学习项目、极端射频频谱条件通信项目、认知干扰机项目、空军先进电子战组件项目、海军认知通信电子战项目等一系列项目也加速推进。

在EA-18G的认知电子战升级工程中,这一思路也得到了明显的体现。原始的AN/ALQ-99和AN/ALQ-218电子战吊舱采用封闭式架构,其内置电子对抗算法难以进行更新迭代。在EA-18G新装备的电子战吊舱NGJ-MB中,美军采用了新的电子攻击算法。新算法表现出了自适应的能力特征,能够通过学习采集到的战场数据而不断优化,得到最佳的电子战策略,从而具备实施认知电子战的能力。这些算法将在电子战吊舱的工厂生产阶段完成装载,在完成列装后仍可通过开放式架构进行未来的进一步更新。

波音公司深度参与了EA-18G的现代化改装项目,项目中的下一代电子攻击单元(NGEAU)包含了EA-18G的新电子攻击算法,旨在“提供机组人员决策辅助,保持电磁频谱的主导地位”。在美军目前披露的信息中,计划于2026年完成全部160架EA-18G的改装。专业评估显示,改装后的EA-18G将至少在10年内保有电子战技术实力和作战优势。E这一款经典机型能有如此活跃的生命力,很大程度得益于模块化开放式架构带来的更新便捷。

首发 | 兰德报告《在电磁频谱中智胜敏捷对手》解读

值得一提的是,该报告研究的重点是实现美空军在执行任务时软件重编程序中各项指标的建设,帮助进一步增强机器学习算法(Machine Learning, ML)。换言之,将电子战和电磁频谱作战管理的数据能够通过软件让机器正确理解,最终使美空军武器平台能够自主学习、重编程序、适应并回击飞行中遇到的各类威胁,而这种基于机器学习的能力被称为认知型电子战。

将人工智能向认知电子战赋能——使用机器学习算法(ML)、让平台能够自主学习、进而重编程序以应对不断变化的威胁挑战。为了实现美空军的最终愿景

image-20231002101137394

该报告多次提到人工智能、机器学习(ML)、深度学习以及认知型电子战(Electronic Warfare,EW)。

报告指出,要关注依赖机载高性能计算的进展,以及在相应尺寸、重量和功率限制范围内,支持计算密集型算法对处理能力的需求。此外,该报告还重点关注将高性能计算机(High-Performance Computing,HPC)装载到能够执行EWIR任务的飞机上,旨在增强机载处理能力(onboard processing,OBP),使飞机能够在执行任务中快速重编程序。同时,飞机还能通过卫星通信和高速数据链接实现与其他武器平台的实时共享。

美国当前电子战能力与项目分析

美国海军有几个新的作战概念打算用来对抗对手,包括海军综合火力控制防空(NIFC-CA)概念,该概念旨在帮助航母航空联队在被拒或干扰的环境中更好地对抗对手。美国海军作战部长在2018年向军事委员会提交的态势证词中讨论了对水面舰队电子战能力的更多投资。EA-18G“咆哮者”电子战飞机是海军电子战项目的支柱,该项目将继续获得资金,以实现其能力现代化,包括为下一代干扰机提供资金。

2022年世界军事装备发展研究——电子战装备篇

美军持续推进电磁作战能力建设

例如,驻西太平洋地区的EA-18G电子攻击机中队,在美军“动态部署”作战概念牵引下,实现三泽、冲绳、关岛等基地的常态派驻轮训,以“快进快撤”模式实现战术不可预测性。

美军将所谓“灰色地带”用作电磁战重要练兵场,意图通过电磁频谱干扰和诱骗误导实现“无形”杀伤。

在机载电磁频谱战装备方面,美F-35战斗机的AN/ASQ-239系统具备实时的战场空间态势感知能力和快速反应能力,是美电磁频谱作战的关键系统。2019年2月,BAE系统公司对该系统进行了升级改进,成功实现新技术插入,使该系统具备了世界一流的电子战能力。2021年1月,诺斯罗普·格鲁曼公司宣布将其AN/ASQ-242综合通信、导航与识别系统和BAE系统公司的AN/ASQ-239进行整合,进一步增强美军电子战能力。目前,AN/ASQ-239系统正处于持续的升级改造阶段。2021年11月,美海军签订新合同,对AN/ASQ-239 Block4电子战系统进行升级。12月,美军与BAE系统公司签订合同,对F-35上的ASQ-239系统进行进一步重大升级。

目前美军已为EC-130H、EA-18G等电子战飞机300余架装备干扰机,其中EC-130H通信干扰机能够截获、分析敌方指挥控制通信网络和防空指挥通信网并实施目标定位,EA-18G飞机可对0.064~18GHz频段内的雷达预警、指挥控制、通信、武器制导等系统实施电子干扰、压制和欺骗。值得注意的是,美军的“下一代干扰机”(NGJ)项目取代了传统的ALQ-99干扰吊舱,为美国海军的EA-18G咆哮者电子战飞机提供了新能力,以扰乱敌方的陆基通信和电磁频谱战能力。美海军计划在2022年使该干扰机达到初始作战能力。

在舰载和潜艇载电磁频谱战装备方面,AN/SLQ-32(V)系统是美海军目前最主要的电磁频谱战系统,也是当下全球范围内最具代表性的舰载电子战系统。自2002年起,美海军从“水面电子战改进计划”(SEWIP)出发,对AN/SLQ-32(V)系统进行持续的阶段性升级,分Block1至Block4四个阶段,旨在提高该系统对反舰导弹攻击的防御能力,并提升舰船对周边威胁的态势感知能力。

美军的认知电子战项目开始于2010年7月美国防部高级研究计划局的自适应电子战行为学习(BLADE)项目。该项目首次尝试将机器学习理论应用到通信电子战领域,核心技术包括机器学习技术及相关自适应学习算法,目标在于开发能够实时检测、分析、对抗的无线通信系统。BLADE系统主要用以实现三项功能:信号检测与描述、干扰波形优化以及作战效果评估,强调电磁频谱战作战人员能够实时控制整个系统并接收反馈,从而形成战场态势感知能力,在这一过程中,机器学习以及人机交互能力在系统中发挥了重要作用。

自适应雷达对抗(ARC)项目是美军认知电子战项目的重要部分,以对抗敌方的自适应雷达信号,主要针对波形和信号行为未知的、随机的防空、空空相控阵雷达,此类雷达具有预警、提示目标截获、跟踪、导弹跟踪等功能。ARC系统能够分析信号、综合对抗敌方的措施并对对抗措施进行效能评估,具备对抗雷达威胁的自主学习能力。

2015年,美国战略与预算评估中心发布《电波致胜:重拾美国在电磁频谱领域主宰地位》研究报告,报告指出自适应化/认知化是未来电子频谱战中的关键技术,美军应重点发展这项能力。随着系列认知电子战项目的展开,美军不断将人工智能、机器学习等技术创新融入电磁频谱战能力中,除BLADE、ARC项目之外,还展开了认知网络电子战项目,研发了破坏者SRx认知电子战系统。2021年9月,美空军发布“怪兽”项目公告。该项目是认知电子战更广泛的升级应用,将研发与人工智能、机器学习相关的新型认知电子战技术,突破敌方的新型综合防空系统,保证美空军在未来电磁频谱战中的技术优势。

美军的电磁频谱战理念适应了现代战争发展的需要,美军各军种在电磁频谱战领域的加速实践推动了美军电磁频谱战向技术智能化、装备无人化以及作战联合一体化的发展演变。在新战略条令的顶层设计指导下,美军正在发展新一代电磁频谱战能力,推动电磁空间与陆-海-空-天-赛博等多维作战域的融合,以应对大国竞争乃至对抗的新需要。

破析现代战场“电磁聚优”的奥秘

电磁攻击的突然性体现了时域聚优的必然性。近几场局部战争实践表明,在实际电子对抗作战中,有些电磁信号持续时间短,开关机频繁,其时域的突变性特别明显,因而,聚集电磁优势是充满隐蔽突然的过程。达成电磁时域聚优的突然性,就是把时域价值作为一种决定性因素,在最短的时间内聚集优势,以先发制人的突然性夺取战争胜利。中东战争中,以色列军队实施“闪电式”电子突袭,对埃及防空雷达和通信系统实施了强烈的电子干扰,并在密集的电子干扰中实行了“挖眼”战术。以军以电磁攻击作战的突然性实现电磁战场时域聚优,埃及军队的指挥控制系统被彻底瘫痪。可见,在任何聚时之优的突发电磁攻击中,必须要巧于施计,出敌不意,以突发优势迅速夺取战场主动权。

科学配置力量是达成空间聚优的重中之重。在电磁频谱空域的布局结构中,合理配置兵力兵器体现了在空间上聚集优势的必然性,使电磁空域各种作战要素功能得到最大的发挥。科索沃战争中,北约部队依据空袭作战需求,调集足够的电子对抗兵力兵器,并把电子战精锐力量聚集在主要作战方向,使用多种软硬杀伤手段,在局部空间对南联盟形成了绝对电磁优势。对聚空间之优的运用,通常根据电子对抗作战目标、作战持续时间来确定,使编配类型与战斗任务相适应,并随着战场变化及时调整变动。尤其是在信息化、智能化战场上,电子对抗武器装备精度高,毁伤力大,机动性强,要求构成集成型电磁专业力量结构,使之合成度更高,综合作战能力更强,以遂行不同强度、不同规模、不同样式的电子对抗作战任务。

优化空间关系是达成空域聚优的重要基础。无论电子侦察与反侦察、干扰与反干扰、摧毁与反摧毁,还是各类电子对抗武器平台,以及从指挥机构到单兵的各级电子战力量,为了实现在空间上聚集优势,无不需要优化战场空间作战要素,加强相互间的配合与协同能力,使兵力部署空间结构要素统一到实现作战行动整体优化上来。海湾战争中,为达成空间聚优的整体联动效果,多国部队充分发挥空中预警指挥机的作用,在空中及时对所有航空兵与电子战飞机进行随机指挥与控制;电子战飞机实施伴随干扰掩护,对伊军雷达及防空配系释放强电子干扰,发射反辐射导弹实施硬压制,为攻击机群打开“空中走廊”,掩护突击机群精确打击等。多国部队投入强大电子战力量,在空间上集中各种电子战设备组成了一个严密的立体电子对抗系统。

精确调控是达成聚集空间优势的重要内容。各种先进的电子对抗装备广泛应用于电磁战场,使得电磁空间形成交叉重叠的电磁辐射态势,而且在不同空域,电磁信号随空间的变化而变化,这在客观上要求聚集空域之优,必须实施动态精确的调控。阿富汗战争中,美军围绕打击塔利班武装和本·拉登领导的“基地”组织,摧毁对手的反击能力,在全纵深、多维度空间对电磁波频率实时作出精确协调控制,电子对抗各专业力量之间即时聚优,协调一致地展开电磁行动,以聚集绝对电磁优势。此举导致塔利班武装和“基地”组织很多重要信息传递被迫采取传统信使方式。值得注意的是,精确协调电磁频谱空间作战行动,是从先期交战开始直到战斗结束全过程不间断实施的。因此,必须强化全频空间的立体全覆盖,注重全部频域作战的协调性,在各频域协调一致地实施电子攻防行动。

谋求能量聚释是电磁控制的根本出发点。电磁领域对抗实质上是电磁能量对抗,在频域、时域、空域上实施电子攻防作战都要通过电磁能量的聚集与释放表现出来。现代战场上,不仅要聚合制导系统的干扰与反干扰、摧毁与反摧毁所产生的能量,以及反辐射武器和强激光武器的效能来破坏、瘫痪敌方作战体系,防护己方目标,更要注重电子对抗武器能量集侦察、识别、定位、压制和摧毁于一体,并更加注重突出硬摧毁能量聚释,摧毁和杀伤目标。在第二次车臣战争中,俄军高度重视在作战能量上聚优的原则,战争开始后无论是首轮电子干扰、电子佯动和欺骗,还是“猎狼行动”,都在重点预歼目标上实施了电磁波能量集中,达到了对敌最大限度破网瘫体的作战效果。运用信息化、智能化手段来控制能量聚释,将是未来电磁能量聚释发展的必然趋势。

有效融合是形成更强能域之优的根本途径。谋求电磁能域优势,突出强调有效聚集电磁资源和优势力量,形成效能融合,实现电子目标探测、跟踪识别、火力控制、作战指挥、电子打击、目标防护、电磁机动、毁伤评估的实时化和一体化。主要表现在如下方面:一是信息要素综合集成,以模块化方式编成的电子对抗力量单元之间实现无缝连接,整个作战行动能在信息的主导下得以灵活、精准、快速、高效地实施。二是电子对抗作战要素横向一体,形成有机作战体系,实现从发现目标到打击目标的实时整体作战。三是战斗要素功能全面多样化,具有遂行各种电磁行动的能力。伊拉克战争中,美军依托多维立体、精确联动的综合电子战系统,发挥整体联动的电子攻防能力,展示了网络化支撑下的综合电子攻防的整体优势效能,表现出聚电磁能域之优的新特征。

首发 | 美国国防部《电磁频谱优势战略》发展分析

美军传统的电子战分类以“电子攻击”(Electronic Attack)、“电子防御”(Electronic Protection)和“电子支援”(Electronic Support)这三大组成部分为主,而这种搭配长期以来忽略了电磁频谱的协调和分配工作。

首发 | 美陆军发布《电磁战排》作战条令

https://mp.weixin.qq.com/s/M5LFpGMB65VQhiMBQxK7kg

https://mp.weixin.qq.com/s/XlyM-OhHkvOq6PoNu219UQ

https://mp.weixin.qq.com/s/EUYUWKekjisap6AwRzR3dA

https://mp.weixin.qq.com/s/1Zg8W7UM7_vPjnl_LM_ePA

https://mp.weixin.qq.com/s/1RpxsHQfsCQupiILgz05LQ

  1. 策略层面,一些不同情况下的作战流程,时序流程,具体场景和具体任务的作战干扰过程
  2. 按照干扰样式分别写 干扰机理和原理

面向舰艇作战软件研制的仿真模型体系建设

软件产品线度量及应用研究

软件复用是提高软件生产力、软件质量的最有潜力的领域,软件产品线实质上是最高级别的软件复用,而软件产品线度量技术对提升软件产品线有帮助,提出了一些重要的度量技术思路,分析了相应的度量指标

仿真模型重用与组合关键技术研究

能够通过灵活地组装已有仿真模型,快速构建满足不同应用需求的仿真系统,及时响应所研究系统的不断演化,保持对其结构组成、行为及过程的建模与仿真的有效性

Software Reuse Research: Status and Future

软件重用是利用现有的软件或软件知识来构建新的软件。可重用资产可以是可重用的软件或软件知识,而可重用性是一个软件资产的属性,表示其被重用的概率。

软件重用研究的主要贡献包括:

  1. 提高软件开发效率和质量:通过重用现有的软件或软件知识,可以减少软件开发的时间和成本,并提高软件的质量和可靠性。
  2. 促进软件工程的发展:软件重用是软件工程的一个重要组成部分,可以促进软件工程的发展和进步。
  3. 提高软件开发人员的技能和能力:通过软件重用,软件开发人员可以学习和掌握更多的软件知识和技能,提高自己的能力和竞争力。

软件重用研究的未解决问题包括:

  1. 软件重用的度量和评估:如何度量和评估软件重用的效果和价值,是软件重用研究中的一个重要问题。
  2. 领域工程:如何将软件重用应用于特定领域的软件开发,是软件重用研究中的一个重要问题。
  3. 软件架构和生成器:如何设计和实现可重用的软件架构和生成器,是软件重用研究中的一个重要问题。
  4. 软件重用的挑战:软件重用面临着许多挑战,如如何管理和维护可重用的软件资产,如何解决软件兼容性和集成性等问题,这些都是软件重用研究中的重要问题。

Dynamic Software Product Lines

这篇论文介绍了动态软件产品线(DSPL)的概念和应用。DSPL是一种软件工程方法,旨在通过使用可重用的组件和变异点来实现软件产品的快速开发和定制化。这篇论文介绍了动态软件产品线(DSPL)的概念和应用。DSPL是一种软件工程方法,旨在通过使用可重用的组件和变异点来实现软件产品的快速开发和定制化。

DSPL的优点包括:

  1. 可以快速开发和定制化软件产品。
  2. 可以提高软件产品的质量和可靠性。
  3. 可以降低软件产品的开发和维护成本。
  4. 可以提高软件产品的可重用性和可扩展性。

DSPL的应用场景包括:

  1. 需要快速开发和定制化软件产品的场景。
  2. 需要提高软件产品质量和可靠性的场景。
  3. 需要降低软件产品开发和维护成本的场景。
  4. 需要提高软件产品可重用性和可扩展性的场景。

DSPL的实现方法包括:

  1. 使用可重用的组件和变异点来实现软件产品的快速开发和定制化。
  2. 使用动态绑定技术来实现软件产品的动态变异。
  3. 使用多智能体系统来实现软件产品的自适应和演化。
  4. 使用动态重构架构来实现软件产品的动态变异和演化。

软件产品线可变性建模技术系统综述

软件产品线是实现大规模的软件复用、保证高质量的新产品开发的最佳实践.

软件产品线的关键问题是如何进行可变性管理,并基于可变性管理实现软件核心资产的复用.

软件产品线可变性建模是可变性管理的关键技术,实现产品家族成员的共性和可变性的描述

A systematic review of evaluation of variability management approaches in software product lines

关于软件产品线工程中可变性管理方法评估的系统性综述

  1. 基于特征模型的方法

    基于特征模型的方法是一种常用的可变性管理方法,它通过定义和描述软件产品线中的特征来管理可变性。特征是指软件产品线中的可变部分,例如不同的功能、性能、平台等等。特征模型是一种用于描述特征之间关系的模型,它可以帮助开发人员理解和管理软件产品线中的可变性。特征模型通常使用树形结构表示,其中根节点表示整个软件产品线,子节点表示不同的特征。特征模型可以用于生成不同的产品,也可以用于验证和分析软件产品线的可变性。

  2. 基于约束模型的方法

    基于约束模型的方法是一种通过定义和描述约束来管理可变性的方法。约束是指软件产品线中的限制条件,例如不同的需求、规范、标准等等。约束模型是一种用于描述约束之间关系的模型,它可以帮助开发人员理解和管理软件产品线中的可变性。约束模型通常使用图形化表示,其中节点表示不同的约束,边表示约束之间的关系。约束模型可以用于生成不同的产品,也可以用于验证和分析软件产品线的可变性。

  3. 基于元模型的方法

    基于元模型的方法是一种通过定义和描述元模型来管理可变性的方法。元模型是一种用于描述模型之间关系的模型,它可以帮助开发人员理解和管理软件产品线中的可变性。元模型通常使用图形化表示,其中节点表示不同的模型元素,边表示元素之间的关系。元模型可以用于生成不同的产品,也可以用于验证和分析软件产品线的可变性。基于元模型的方法通常需要使用特定的建模语言和工具,例如UML、Ecore等等。

基于复用的军用软件构件化与生产线技术探讨

军用软件构件化

image-20230720144356338

船舶列队协同控制方法研究综述

涉及的主要问题有人机共驾、系统建 模、控制一致性、通信受限等

  1. 人机共驾控制问题

    如何合理地分配人与机器在驾控中的角色与 权重,利用人机的差异性和互补性提升列队航行 的技术效能,是需要解决的关键问题

  2. 列队控制运动不确定性建模问题

    建立精确的列 队控制运动模型是当下亟需突破的一个技术难点

  3. 列队协同控制一致性问题

    解决异质船舶列队中的一致性控制问题 是未来研究的难点问题

  4. 通信受限下船舶列队鲁棒控制问题


title:期刊

MIS领域的国际顶级期刊公认的最顶级三大期刊是 MIS Quarterly(MISQ), Management Science(MS)和Information Systems Research(ISR)。此外,Journal of Management Information Systems(JMIS),INFORMS Journal on Computing,Communications of ACM也很厉害,仅次于三大公认。其余比较好的有Journal of the Association for Information Systems ,Decison Support Systems(DSS), Information & Management, Journal of Strategic Information Systems……….很多,就不一一列举了。

中文期刊方面,《管理世界》是公认管理学领域最顶级中文期刊,《科研管理》、《南开管理评论》、《管理科学学报》等次之,都是管理学中文一流期刊。稍微次之的有《管理科学》、《管理工程学报》等。

期刊的影响因子每年都变,但排名也会小幅变化,但在学科的地位短时间内一般不变。在一段时间内,排名靠前的期刊依然排名靠前。

附件是计算机领域的学术会议等级排名情况,分为A+, A, B, C, L 共5个档次。其中A+属于顶级会议,基本是这个领域全世界大牛们参与和关注最多的会议。国内的研究者能在其中发表论文的话,是很值得骄傲的成就。

A类也是非常好的会议了,尤其是一些热门的研究方向,A类的会议投稿多录用率低,部分A类会议影响力逐步逼近A+类会议。B类的会议分两种,一种称为盛会级,参与的人多,发表的论文也多,论文录用难度比上两个级别要低很多,通常是行业内的学者们年度交流的好时机。一种是专业级的小会,圈子往往比较小,但是也有一些相对质量不错的成果发表。另外B类也是一个分水岭,是区分NB成果和普通成果的分界线,往下的C类会议知名度就低很多了,而L级的会议更多。如果不是为了注水,而是追求论文的质量多过数量的话,不建议在L级会议上发表论文。除此以外计算机还有更多的会议不在列表内,这些属于更不入流的会议了

CORE Computer Science Conference Rankings

Acronym Standard Name Rank
AAAI National Conference of the American Association for Artificial Intelligence A+
AAMAS International Conference on Autonomous Agents and Multiagent Systems A+
ACL Association of Computational Linguistics A+
ACMMM ACM Multimedia Conference A+
ASPLOS Architectural Support for Programming Languages and Operating Systems A+
CAV Computer Aided Verification A+
CCS ACM Conference on Computer and Communications Security A+
CHI International Conference on Human Factors in Computing Systems A+
COLT Annual Conference on Computational Learning Theory A+
CRYPTO Advances in Cryptology A+
CSCL Computer Supported Collaborative Learning A+
DCC IEEE Data Compression Conference A+
DSN International Conference on Dependable Systems A+
EuroCrypt International Conference on the Theory and Application of Cryptographic Techniques A+
FOCS IEEE Symposium on Foundations of Computer Science A+
FOGA Foundations of Genetic Algorithms A+
HPCA IEEE Symposium on High Performance Computer Architecture A+
I3DG ACM-SIGRAPH Interactive 3D Graphics A+
ICAPS International Conference on Automated Planning and Scheduling A+
ICCV IEEE International Conference on Computer Vision A+
ICDE IEEE International Conference on Data Engineering A+
ICDM IEEE International Conference on Data Mining A+
ICFP International Conference on Functional Programming A+
ICIS International Conference on Information Systems A+
ICML International Conference on Machine Learning A+
ICSE International Conference on Software Engineering A+
IJCAI International Joint Conference on Artificial Intelligence A+
IJCAR International Joint Conference on Automated Reasoning A+
INFOCOM Joint Conference of the IEEE Computer and Communications Societies A+
InfoVis IEEE Information Visualization Conference A+
IPSN Information Processing in Sensor Networks A+
ISCA ACM International Symposium on Computer Architecture A+
ISMAR IEEE and ACM International Symposium on Mixed and Augmented Reality A+
ISSAC International. Symposium on Symbolic and Algebraic Computation A+
ISWC IEEE International Symposium on Wearable Computing A+
IWQoS IFIP International Workshop on QoS A+
JCDL ACM Conference on Digital Libraries A+
KR International Conference on Principles of KR & Reasoning A+
LICS IEEE Symposium on Logic in Computer Science A+
MOBICOM ACM International Conferencem on Mobile Computing and Networking A+
NIPS Advances in Neural Information Processing Systems A+
OOPSLA ACM Conference on Object Oriented Programming Systems Languages and Applications A+
OSDI Usenix Symposium on Operating Systems Design and Implementation A+
PERCOM IEEE International Conference on Pervasive Computing and Communications A+
PERVASIVE International Conference on Pervasive Computing A+
PLDI ACM-SIGPLAN Conference on Programming Language Design & Implementation A+
PODC ACM Symposium on Principles of Distributed Computing A+
PODS ACM SIGMOD-SIGACT-SIGART Conferenceon Principles of Database Systems A+
POPL ACM-SIGACT Symposium on Principles of Prog Langs A+
RSS Robotics: Systems and Science A+
RTSS Real Time Systems Symp A+
SENSYS ACM Conference on Embedded Networked Sensor Systems A+
SIGCOMM ACM Conference on Applications, Technologies,Architectures, and Protocols for Computer Communication A+
SIGGRAPH ACM SIG International Conference on Computer Graphics and Interactive Techniques A+
SIGIR ACM International Conference on Research and Development in Information Retrieval A+
SIGKDD ACM International Conference on Knowledge Discovery and Data Mining A+
SIGMETRICS ACM SIG on computer and communications metrics and performance A+
SIGMOD ACM Special Interest Group on Management of Data Conference A+
SODA ACM/SIAM Symposium on Discrete Algorithms A+
SOSP ACM SIGOPS Symposium on Operating Systems Principles A+
STOC ACM Symposium on Theory of Computing A+
UAI Conference in Uncertainty in Artifical Intelligence A+
UbiComp Uniquitous Computing A+
VLDB International Conference on Very Large Databases A+
WWW International World Wide Web Conference A+
ACM-HT ACM Hypertext Conf A
AH International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems A
AID International Conference on AI in Design A
AIED International Conference on Artificial Intelligence in Education A
AIIM Artificial Intelligence in Medicine A
AIME Artificial Intelligence in Medicine in Europe A
AiML Advances in Modal Logic A
ALENEX Workshop on Algorithm Engineering and Experiments A
ALIFE International Conference on the Simulation and Synthesis of Living Systems A
AMAI Artificial Intelligence and Maths A
AMIA American Medical Informatics Annual Fall Symposium A
AOSD Aspect-Oriented Software Development A
APPROX International Workshop on Approximation Algorithms for Combinatorial Optimization Problems A
ASAP International Conference on Apps for Specific Array Processors A
ASE Automated Software Engineering Conference A
ASIACRYPT International Conference on the Theory and Applications of Cryptology A
ASIS&T Annual conference of American Society for Information Science and Technology A
ATVA International Symposium on Automated Technology for Verification and Analysis A
AVSS Advanced Video and Signal Based Surveillance A
BMVC British Machine Vision Conference A
BPM International Conference in Business Process Management A
CADE International Conference on Automated Deduction A
CAIP International Conference on Computer Analysis of Images and Patterns A
CaiSE International Conference on Advanced Information Systems Engineering A
CANIM Computer Animation A
CASES International Conference on Compilers, Architecture, and Synthesis for Embedded Systems A
CBSE International Symposium Component-Based Software Engineering A
CC International Conference on Compiler Construction A
CCC IEEE Symposium on Computational Complexity A
CCGRID IEEE Symposium on Cluster Computing and the Grid A
CDC IEEE Conference on Decision and Control A
CGI Computer Graphics International A
CGO Code Generation and Optimization A
CIDR Conference on Innovative Data Systems Research A
CIKM ACM International Conference on Information and Knowledge Management A
CLUSTER Cluster Computing Conference A
COCOON International Conference on Computing and Combinatorics A
CogSci Annual Conference of the Cognitive Science Society A
COLING International Conference on Computational Liguistics A
CONCUR International Conference on Concurrency Theory A
CoNLL Conference on Natural Language Learning A
CoopIS International Conference on Cooperative Information Systems A
Coordination International Conference on Coordination Models and Lanuguages A
CP International Conference on Principles & Practice of Constraint Programming A
CPAIOR International Conference on Integration of Artificial Intelligence and Operations Research Techniques in Constraint Programming for Combinatorial Optimization Problems A
CSB IEEE Computational Systems Bioinformatics Conference A
CSCW ACM Conference on Computer Supported Cooperative Work A
CSFW IEEE Computer Security Foundations Workshop A
CSSAC Cognitive Science Society Annual Conference A
CVPR IEEE Conference on Computer Vision and Pattern Recognition A
DAC Design Automation Conf A
DAS International Workshop on Document Analysis Systems A
DASFAA Database Systems for Advanced Applications A
DATE IEEE/ACM Design, Automation & Test in Europe Conference A
DEXA International Conference on Database and Expert Systems Applications A
DIGRA Digital Games Research Conference A
DIS Designing Interactive Systems A
DISC International Symposium on Distributed Computing (ex WDAG) A
DocEng ACM Symposium on Document Engineering A
DOOD Deductive and Object-Oriented Databases A
DUX Design for User Experience A
EAAI Engineering Applications of Artifical Intelligence A
EACL European Association of Computational Linguistics A
EASE International Conference on Evaluation and Assessment in Software Engineering A
EC ACM Conference on Electronic Commerce A
ECAI European Conference on Artificial Intelligence A
ECCV European Conference on Computer Vision A
ECDL European Conference on Digital Libraries A
ECIS European Conference on Information Systems A
ECML European Conference on Machine Learning A
ECOOP European Conference on object-oriented programming A
ECRTS Euromicro Conference on Real-Time Systems A
ECSCW European Conference on Computer Supported Cooperative Work A
ECWeb International Conference on Electronic Commerce and Web Technology A
EDBT Extending Database Technology A
EKAW International Conference on Knowledge Engineering and Knowledge Management A
EMMSAD Exploring Modelling Methods in Systems Analysis and Design A
EMNLP Empirical Methods in Natural Language Processing A
EMSOFT ACM Conference on Embedded Software A
ESA European Symposium on Algorithms A
e-science IEEE International Conference on e-science and Grid Computing A
ESEM Internation Symposium on Empirical Software Engineering and Measurement A
ESOP European Symposium on Programming A
ESORICS European Symposium on Research in Computer Security A
ESQARU International Joint Conference on Qualitative and Quantitative Practical Reasoning A
ESWC European Semantic Web Conference A
EuroCOLT European Conference on Computational Learning Theory A
EUROGRAPH European Graphics Conference A
EuroPar International Conference on Parallel Processing A
EuroPVM/MPI Euopean PVM/MPI Uswers’ Group Conference A
EuroSpeech European Conference on Speech Communication and Technology A
EuroSPI European SPI A
EuroSys Eurosys Conference A
EWSN European conference on Wireless Sensor Networks A
FCCM IEEE Symposium on Field Programmable Custom Computing Machines A
FLOPS International Symposium on Functional and Logic Programming A
FME Formal Methods Europe A
FODO International Conference on Foundation on Data Organization A
FORTE IFIP Joint Int’l Conference on Formal Description Techniques and Protocol Specification, Testing, And Verification A
FPSAC Formal Power Series and Algebraic Combinatorics A
FSE ACM Conference on the Foundations of Software Engineering (inc ESEC-FSE when held joInternationaly [sic]) A
FSR International Conference on Field and Service Robotics A
FST&TCS Foundations of Software Technology & Theoretical Computer Science A
FUZZ-IEEE IEEE International Conference on Fuzzy Systems A
GD Graph Drawing A
Grid International Conference on Grid Computing A
Group ACM Special Interest Group on Supporting Group Work (was SIGGRoup) A
HiPC International Conference on High Performance Computing A
HOTCHIPS (HCS) Symposium on High Performance Chips A
HOTNETS ACM Workshop on Hot Topics in Networks A
HotOS USENIX Workshop on Hot Topics in Operating Systems A
HPDC IEEE International Symposium on High Performance Distributed Computing A
Hypertext ACM Conference on Hypertext and Hypermedia A
IC3N International Conference on Computer Communication and Networks A
ICADL International Conference of Asian Digital Libraries A
ICALP International Colloquium on Automata, Languages and Programming A
ICALT IEEE International Conference on Advanced Learning Technologies A
ICARCV International Conference on Control, Automation, Robotics and Vision A
ICC IEEE International Conference on Communications A
ICCAD International Conference on Computer-Aided Design A
ICCL IEEE International Conference on Computer Languages A
ICCS International Conference on Computational Science A
ICCS International Conference on Conceptual Structures A
ICDAR IEEE International Conference on Document Analysis and Recognition A
ICDCS IEEE International Conference on Distributed Computing Systems A
ICDT International Conference on Database Theory A
ICECCS IEEE International Conference on Engineering and Complex Computer Systems A
ICER International Computing Education Research Workshop A
ICGG International Conference on Grid Computing A
ICIAP International Conference on Image Analysis and Processing A
ICIP IEEE International Conference on Image Processing A
ICLP International conference on Logic Programming A
ICMAS International Conference on Multi Agent Systems A
ICNN IEEE International Conference on Neural Networks A
ICNP International Conference on Network Protocols A
ICONIP International Conference on Neural Information Processing A
ICPP International Conference on Parallel Processing A
ICPR International Conference on Pattern Recognition A
ICS ACM International Conference on Supercomputing A
ICSC2 International Computer Symposium Conference A
ICSM International. Conferenceon Software Maintenance A
ICSOC International Conference on Service Oriented Computing A
ICSP International Conference on Software Process A
ICSPC International Conference on Security in Pervasive Computing A
ICSR IEEE International Conference on Software Reuse A
ICTL International Coference on Temporal Logic A
IDA Intelligent Data Analysis A
IEEE-Alife IEEE International Symposium on Artificial Life A
IEEE-CEC Congress on Evolutionary Computation A
IEEE-MM IEEE International Conference on Multimedia Computing and Systems A
IEEETKDE IEEE Transactions on Knowledge and Data Engineering A
IFIP_WG 11.3 IFIP WG 11.3 Working Conference on Data and Applications Security (was IFIP-DBSEC) A
IJCNLP International Joint Conference on Natural Language Processing A
IJCNN IEEE International Joint Conference on Neural Networks A
ILPS International Logic Programming Symposium A
IM IFIP/IEEE Integrated Management (odd years sharing with NOMS) A
IMC Internet Measurement Conference A
INTERACT IFIP International Conference on Human-Computer Interaction A
IPCO MPS Conference on integer programming & combinatorial optimization A
IPDPS IEEE International Parallel and Distributed Processing Symposium (was IPPS and SPDP) A
ISAAC International Symposium on Algorithms and Computation A
ISD International Conference on Information Systems Development A
ISESE International Symposium on Empirical Software Engineering A
ISMB Intelligent Systems in Molecular Biology A
ISR International Symposium on Robotics A
ISSCC IEEE International Solid-State Circuits Conference A
ISSR International Symposium on Robotics Research A
ISSRE International Symposium on Software Reliability Engineering A
ISSTA Internation Symposium on Software Testing and Analysis A
ISTA International Conference on Information Systems Technology and its Application A
ISTCS Israel Symposium on Theory of Computing and Systems A
ISWC International Semantic Web Conference A
ITiCSE Annual Conference on Integrating Technology into Computer Science Education A
ITS International Conference on Intelligent Tutoring Systems A
IUI Intelligent User Interfaces A
IVCNZ Image and Vision Computing Conference A
JELIA Logics in Artificial Intelligence, European Conference A
JICSLP/ICLP/ILPS International Conference/Symposium on Logic Programming (Joint) A
K-CAP Knowledge capture A
LCN IEEE Conference on Local Computer Networks A
LCTES ACM SIGPLAN Conference on Languages, Tools, and Compilers for Embedded Systems A
LPAR Logic Programming and Automated Reasoning A
LPNMR International Conference on Logic Programming and Non-monotonic Reasoning A
MASCOTS Symposium Model Analysis & Simulation of Computer & Telecommunications Systems A
MASS IEEE International Conference on Mobile Ad-hoc and Sensor Systems A
MassPar Symposium on Frontiers of Massively Parallel Processing A
MICRO International Symposium on Microarchitecture A
Middleware ACM/IFIP/USENIX th International Middleware Conference A
MIR ACM SIGMM International Woekshop on Multimedia Information Retrieval A
MMCN ACM/SPIE Multimedia Computing and Networking A
MMSP International Workshop on Multimedia Signal Processing A
MOBIHOC ACM Symposium of mobile and ad hoc computing A
MobileHCI International Conference on Human-Computer Interaction with Mobile Devices and Services A
Mobiquitous International Conference on Mobile and Ubiquitous Systems: Networks and Services A
Mobisys ACM SIGMOBILE International Conference on mobile systems, applications and services A
MODELS International Conference on the Unified Modeling Language (formerly UML) A
MSWIM ACM/IEEE International Conference on Modelling, Analysis and Simulation of Wireless and Mobile Systems A
NAACL North American Association for Computational Linguistics A
NDSS Usenix Networked and Distributed System Security Symposium A
Net Object Days Includings [sic] MATES, ENASE etc. A
NetStore Network Storage Symposium A
Networking 200X IFIP Networking 200X A
NOSSDAV Network and OS Support for Digital A/V A
NSDI Symposium on Networked Systems, Design and Implementation A
OPENARCH IEEE Conference on Open Architecture and Network Programming A
P2P IEEE International Conference on Peer-toPeer Computing A
PACT International Conference on Parallel Architecture and Compilation Techniques A
PADL Practical Aspects of Declarative Languages A
PADS ACM/IEEE/SCS Workshop on Parallel & Distributed Simulation A
PAKDD Pacific-Asia Conference on Knowledge Discovery and Data Mining A
PDC Participatory Design Conference A
PEPM ACM SIGPLAN Workshop on Partial Evalutation and Program Manipulation A
PERFORMANCE IFIP International Symposium on Computing Performance, Modelling, Measurement and Evaluation A
PG Pacific Graphics A
PKDD European Conference on Principles and Practice of Knowledge Discovery in Databases A
PPoPP Principles and Practice of Parallel Programming A
PPSN Parallel Problem Solving from Nature A
PRO-VE IFIP Working Conferences on Virtual Enterprises A
PT Performance Tools - International Conference on Model Techniques & Tools for CPE A
QoSA Conference on the Quality of Software Architectures A
QSIC International Quality Software Conference A
RAID Symposium on Recent Advances in Intrusion Detection A
RANDOM International Workshop on Randomization and Computation A
RE IEEE Requirements Engineering A
RECOMB Annual International Conferenceon Comp Molecular Biology A
RoboCup Robot Soccer World Cup A
RST International Conference on Reliable Software Technologies A
RTA International Conference on Rewriting Techniques and Applications A
RTAS IEEE Real-Time and Embedded Technology and Applications Symposium A
S&P IEEE Symposium on Security and Privacy A
SARA Symposium on Abstraction, Reformulation and Approximation A
SAS Static Analysis Symposium A
SAT International Conference on Theory and Applications of Satisfiability Testing A
SCA ACM SIGGRAPH/Eurographics Symposium on Computer Animation A
SCC IEEE International Conference on Services Computing A
SCG ACM Symposium on Computational Geometry A
SCOPES International Workshop on Software and Compilers for Embedded Systems A
SDM SIAM International Conference on Data Mining A
SDSDI Unix Symposium on Operating Systems Design and Implementation A
SIGCSE ACM Special Interest Group on Computer Science Education Conference A
SMS IEEE International Symposium on Software Metrics A
SPAA Symposium on Parallelism in Algorithms and Architectures A
SPICE Software Process Improvement and Capability Determination A
SRDS Symposium on Reliable Distributed Systems A
SSDBM International Conference on Scientific and Statistical Data Base Management A
SSPR Structural and Statistical pattern recognition A
SSR ACM Symposium on Software Reusability A
SSTD International Symposium on Spatial Databases A
STACS Symposium on Theoretical Aspects of Computer Science A
SUPER ACM/IEEE Supercomputing Conference A
SWAT Scandinavian Workshop on Algorithm Theory A
TABLEAUX International Conference on Theorem Proving with Analytic Tableaux and Related Methods A
TACAS Tools and Algorithms for Construction and Analysis of Systems A
TARK Theoretical Aspects of Rationality and Knowledge A
TIME International Symposium on Temporal Representation and Reasoning A
TREC Text Retrieval Conference A
UIST ACM Symposium on User Interface Software and Technology A
UM International Conference on User Modelling A
USENIX USENIX Annual Technical Conference A
USENIX-Security Usenix Security A
USITS Unix Symposium on Internet Technologies A
VCIP SPIE International Conference on Visual Communications and Image Processing A
VIS IEEE Visualization A
VL/HCC IEEE Symposium on Visual Languages and Human-Centric Computing (was VL) A
VLSI IEEE Symposium VLSI Circuits A
VMCAI Verification, Model Checking and Abstract Interpretation A
WACV IEEE Workshop on Apps of Computer Vision A
WADS Workshop on Algorithms and Data Structures A
WICSA EEE/IFIP Working Conference on Software Architecture A
WISE International Conference on Web Information Systems Engineering A
WoWMoM IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks A
WPHOL International Conference on Theorem Proving in Higher Order Logics A
AAAAECC International Symposium on Applied Algebra, Algebraic Algorithms and Error-Correcting Codes B
AAIM Conference on Algorithmic Aspects in Information and Management B
ACAL Australian Conference on Artificial Life B
ACCV Asian Conference on Computer Vision B
ACE Australasian Conference on Computer Science Education B
ACIS Australasian Conference on Information Systems B
ACISP Australasian Conference on Information Security and Privacy B
ACIVS Advanced Concepts for Intelligent Vision Systems B
ACOSM Australian Conference on Software Metrics B
ACRA Australian Conference on Robotics and Automation B
ACS Australian Supercomputing Conf B
ACSAC Australasian Computer Systems Architecture Conference (now Asia-Pacific Computer Systems Architecture Conference) B
ACSC Australasian Computer Science Conference B
ACSD Application of Concurrency to System Design B
ADBIS Symposium on Advances in DB and Information Systems B
ADC Australasian Database Conference B
ADCS Australasian Document Computing Symposium B
ADHOC-NOW International Conference on AD-HOC Networks & Wireless B
ADTI International Symposium on Advanced DB Technologies and Integration B
AI*IA Congress of the Italian Assoc for AI B
AINA International Conference on Advanced Information Networking and Applications (was ICOIN) B
AISP Australasia Conference on Information Security and Privacy B
ALEX Algorithms and Experiments B
ALG ENGG Workshop on Algorithm Engineering B
ALP International Conference on Algebraic and Logic Programming B
ALTAW Australasian Language Techology Association Workshop B
AMCIS Americas Conference on Information Systems B
AMOC Asian International Mobile Computing Conferrence B
ANALCO Workshop on Analytic Algorithms and Combinatorics B
ANNIE Artificial Neural Networks in Engineering Conference B
ANTS International Workshop on Ant Colony B
ANZIIS Australian and New Zealand Intelligent Information Systems Conference B
AofA Conference on Analysis of Algorithms B
AOIR Internet Research B
AOIS Agent-Oriented Information Systems Workshop B
AOSE Agent-Oriented Software Engineering Workshop B
APAMI Asia Pacific Association for Medical Informatics Conference B
APBC Asia-Pacific Bioinformatics Conference B
APCC IEEE Asia Pacific Conference on Communications B
APCHI Asia-Pacific Conference on Computer Human Interaction B
APLAS ASIAN Symposium on Programming Languages and Systems B
APNOMS Asia-Pacific Network Operations and Management Symposium B
APSEC Asia-Pacific Software Engineering Conference B
APWEB Asia Pacific Web Conference B
ARA National Conference of the Australian Robot Association B
ARES International Conference on Availability, Reliability and Security B
ASADM Chicago ASA Data Mining Conference- A Hard Look at DM B
ASIAN Asian Computing Science Conference B
ASS IEEE Annual Simulation Symposium B
ASWEC Australian Software Engineering Conference B
ASWEC Australian Software Engineering Conference B
AUIC Australasian User Interface Conference B
AusAI Australian Joint Conference on Artificial Intelligence B
AusDM Australian Data Mining Conference B
AusWIT Australian Women in IT Conference B
AWOCA Australasian Workshop on Combinatorial Algorithms B
AWRE Australian Workshop on Requirements Engineering B
AWTI Argentine Workshop on Theoretical Informatics B
BASYS IEEE/IFIP International Conference on Information Technology for Balanced Automation Systems B
BNCOD British National Conference on Databases B
Broadnets International Conference on Broadband Communications, Networks and Systems B
CAAI Canadian Artificial Intelligence Conference B
CAAN Workshop on Combinatorial and Algorithmic Aspects of Networking B
CACSD IEEE/IFAC Joint Symposium on Intelligent Control B
CAIA Conference on Artificial Intelligence for Applications B
CATS Computing: The Australasian Theory Symposium B
CCA IEEE International Conference on Control Applications B
CCCG Canadian Conferenceon Computational Geometry B
CCW IEEE Computer Communications Workshop B
CD IFIP/ACM Working Conference on Component Deployment B
CEAS International Conference on Email and Anti-Spam B
CEC/EEE IEEE Conference on Electronic Commerce Technology and Enterprise Computing, e_Commerce and e-Services B
CGA Workshop on Computational Geometry and Applications B
CHES Cryptographic Hardware and Embedded Systems B
CIAA International Conference on Implementation and Application of Automata B
CIAC Italian Conference on Algorithms and Complexity B
CICLING Conference on Intelligent Text Processing and Computational Linguistics B
CISTM Conference on Information Science, Technology and Management B
CITB Complexity and information-theoretic approaches to biology B
COCOA Conference on Combinatorial Optimization and Applications B
COMAD International Conference on Management of Data B
COMMONSENSE Symposium on Logical Formalizations of Commonsense Reasoning B
CompLife International Symposium on Computational Life Science B
COMPSAC International Computer Software and Applications Conference B
CONPAR International Conference on Vector and Parallel Processing B
CPM Combinatorial Pattern Matching B
CSL, 2 th Annual Conference on Computer Science Logic B
DAC Digital Arts and Culture B
DAFX Digital Audio Effects Conference B
DAIS IFIP International Conference on Distributed Applications and Inoperable Systems B
DaWaK Data Warehousing and Knowledge Discovery B
DB&IS International Baltic Conference on Databases and Information Systems B
DCOSS IEEE Conference on Distributed Computing in Sensor Systems B
DICTA Australian Pattern Recognition Society Conference B
DISRA IEEE International Workshop on Distributed Intelligent Simululation and Real-Time Applications B
DITW Internationale Tagung Wirtschaftsinformatik B
DLT Developments in Language Theory B
DMTCS International Conference on Discrete Mathematics and Theoretical Computer Science B
DNA Meeting on DNA Based Computers B
DSOM IFIP/IEEE International Workshop on Distributed Systems Operations and Management B
DS-RT Distributed Simulation and Real-time Applications B
DSS Distributed Simulation Symposium B
DX Diagnostics B
DYSPAN IEEE Dynamic Spectrum Access Networks B
ECAIM European Conference on AI in Medicine B
ECAL European Conferene on Artificial Life B
ECBS Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems B
ECCB European Conference on Computational Biology B
ECEG Eurpopean Conference on e-Government B
ECIME European Conference on Information Management and Evaluation B
ECIR European Conference on Information Retrieval B
ED-MEDIA World Conference on Educational Multimedia, Hypermedia and Telecommunications B
EDOC The Enterprise Computing Conference B
EEE IEEE e-technology, e-service and e-commerce conference B
EGC European Grid Conference B
Emnets IEEE Embedded Sensor Networks Worskhop B
EPIA Portuguese Conference on Artificial Intelligence B
ER International Conference on Conceptual Modeling B
ERCIM/CSCLPERCIM Annual Workshop on Constraint Solving and Contraint Logic Programming B
ESEA Euromicro International Conference on software engineering and applications B
ESEC European Software Engineering Conference B
ESM European Simulation Multiconference B
ESS European Simulation Symposium B
EuAda Ada-Europe International Conference on Reliable Software Technologies B
EUROGP European Conference on Genetic Programming B
EuroPDP EUROMICRO Conference on Parallel, Distributed and Network-Based processing B
EUSIPCO European Signal Processing Conference B
EWLR European Workshop on Learning Robots B
FASE Fundamental Approaches to Software Engineering B
FCKAML French Conference on Knowledge Acquisition & Machine Learning B
FCT Fundamentals of Computation Theory B
FEM International Conference on Formal Engineering Methods B
FEWFDB Far East Workshop on Future DB Systems B
FIE Frontiers in Education B
FINCRY Financial Cryptography B
FOSSACS Foundations of Software Science and Computational Structures B
FSENCRY Fast Software Encryption B
FTP International Workshops on First-Order Theorem Proving B
FTRTFT Formal Techniques in Real-Time and Fault Tolerant Systems B
FUN Conference on fun with algorithms B
GECCO Genetic and Evolutionary Computations B
GLOBECOM IEEE Global Telecommunications Conference B
GMP Geometry Modeling and Processing B
GPCE International Conference on Generative Programming and Component Engineering B
HASE IEEE International Symposiumon High Assurance Systems Engineering B
HICSS Hawaii International Conference on System Sciences B
HLT Human Language Technologies B
HPCN International Conference on High Performance Computing and Networking B
HPSR IEEE Workshop on High Performance Switching and Routing B
IAAI Innovative Applications in AI B
ICA3PP IEEE International Conference on Algorithms and Architectures for Parallel Processing B
ICAIL International Conference on Artificial Intelligence and Law B
ICANN International Conference on Artificial Neural Networks B
ICASSP IEEE International Conference on Acoustics, Speech and Signal Processing B
ICATPN International Conference on the Application and Theory of Petri Nets B
ICCB International Conference on Case-Based Reasoning B
ICCBSS IEEE International Conference on COTS-Based Software Systems B
ICCE International Conference on Computers in Education B
ICCI International Conference on Computing and Information B
ICDCN IEEE International Conference on Distributed Computing and Networking B
ICEBE IEEE Conference on e-Business Engineering B
ICEIMT International Confernce on Enterprise Integration and Modelling Technology B
ICEIS International Conference on Enterprise Information Systems B
ICGA International Conference on Genetic Algorithms B
ICGT International Conference on Graph Transformations B
ICICSec International Conference on Information and Communications Security B
ICME IEEE International Conference on Multimedia & Expo B
ICMS International Conference on Multiagent Systems B
ICON IEEE International Conference on Networks B
ICPADS IEEE International Conference on Parallel and Distributed Systems B
ICRA IEEE International Conference on Robotics and Automation B
ICSC International Computer Science Conference B
ICSEA International Conference on Software Engineering Advances B
ICSEC International Conferenceon Information and Communications Security B
IC-Soft International Conference on Software and Data Technologies B
ICTAC International Colloquium on Theoretical Ascpects of Computing B
ICTAI IEEE International Conference on Tools with Artificial Intelligence B
ICWS IEEE International Conference on Web Services B
IDEAS International Database Engineering and Applications Symposium B
IE Interactive Entertainment B
IEAAI International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems B
IEEE RFID IEEE International Conference on Remote Frequency Identification B
IEEE-IV Intelligent Vehicles Conference B
IFM Integrated Formal Methods B
IFSA IFSA World Congress B
IJCNLP2 International Joint Conference on Computational Linguistics B
ILP Inductive Logic Programming B
IN IEEE Intell Network Workshop B
INBS IEEE International Symposium on Intelleligence in Neural & Biological Systems B
INET Internet Society Conference B
INFH Workshop on Information Hiding B
InSITE Informing Science and IT Education Conference B
IPCCC IEEE International Performance Computing and Communications Conference B
IRIS Information Systems Research Seminar in Scandinavia B
IRMA Information Resources Management Association International Conference B
IROS IEEE/RSJ International Conference on Intelligent Robots and Systems B
ISCC IEEE Symposium on Computers & Communications B
ISCIS International Symposium on Computer and Information Sciences B
ISEAT Integration of Software Engineering and Agent Technology B
ISIC IEEE International Symposium on Intelligent Control B
ISMM International Symposium on Memory Management B
ITC IEEE International Test Conference B
IWANN International Work-Conference on Artificial and Natural Neural Networks B
IWCASE International Workshop on Cumpter-Aided Software Eng B
IWCMC ACM International Wireless Communications and Mobile Computing Conference B
IWPEC International Workshop on Parameterized and Exact Computation B
JCSC Journal of Computing Science in Colleges (conference proceedings) B
JMLC Joint Modular Languages Conference B
KES International Conference on Knowledge-Based and Intelligent Information and Engineering Systems B
KI German AI conference B
Koli Calling Baltic Sea Conference on Computing Education Research B
LATIN International Symposium on Latin American Theoretical Informatics B
LDTA Language Descriptions, Tools and Applications B
LENLS Logic & Engineering of Natural Language Semantics B
LFCS Logical Foundations of Computer Science B
LOPSTR International Symposium on Logic-based Program Synthesis and Transformation B
LPMA International Workshop on Logic Programming and Multi-Agents B
M2VIP Mechatronics and Machine Vision in Practice B
MATES German conference on Multi-Agent system Technologies B
MCU Universal Machines and Computations B
MDM International Conference on Mobile Data Access/Management (MDA/MDM) B
MEDINFO World Congeress on Medical Informatics B
MEGA Methods Effectives en Geometrie Algebrique B
MFCS Mathematical Foundations of Computer Science B
MLMI Joint workshop on Multimodal Interaction and Related Machine Learnig Algorithms B
MMM Multimedia Modelling B
MPC Mathematics of Program Construction B
MPCS International Conference on Massively Parallel Computing Systems B
MPPOI Massively Parallel Processing Using Optional Interconnections B
NCC National Conference Communications B
NGDB International Symposium on Next Generation Data Base Systems and Applications B
NOMS IEEE Network Operations and Management Symposium B
NORDCHI Norwegian Computer Human Interaction B
ODP IFIP International Conference on Open Distributed Processing B
OPODIS International Conference on Principles of Distributed Systems B
OZCHI Australian Computer Human Interaction Conference B
PACES Pacific Asian Conference on Expert Systems B
PACIS Pacific Asia Conference on Information Systems B
PACLIC Pacific Asia Conference on Language, Information and Computation B
PACLING Conference of the Pacific Association for Computational Linguistics B
PAM Passive and Active Measurement Conference B
PASTE ACM SIGSOFT Workshop on Program Analysis for Software Tools and Engineering B
PATAT Practice and Theory of Automated Timetabling B
PDCAT International Conference on Parallel and Distributed Computing, Applications and Technologies B
PIMRC IEEE International Symposium on Personal and Indoor Mobile Radio Conference B
PKAW Pacific Rim Knowledge Acquisition Workshop B
PKC Public Key Cryptosystems B
PLILP Symposium on Programming Language Implementation and Logic Programming B
PPDP International Conference on Principles and Practice of Declarative Programming B
PPIG Annual PPIG Workshop B
PRICAI Pacific Rim International Conference on Artificial Intelligence B
PRIMA Pacific Rim International Workshop on Multi-Agents B
PROFES Product Focused Software Process Improvement B
PROSim International Workshop on Software Process Simulation and Modeling B
PSI Ershov conference B
Qsine International Conference on Quality of Service in Heterogeneous Wired/Wireless Networks B
QualIT International Conference on Qualitative Research in IT & IT in Qualitative Research B
REFSQ International Workshop on Requirements Engineering: Foundation for Software Quality B
RIDE International Workshop on Research Issues in Data Engineering B
RSA RSA Conference (a security conference) B
RTCSA International Conference on Real-Time and Embedded Computing Systems and Applications B
SAC ACM Symposium on Applied Computing B
SAFECOMP International Conference on Computer Safety, Reliability and Security B
SAFEProcess IFAC Symposioum on Fault Detection, Supervision and Safety of Technical Processes B
SAGA Symposium on Stochastic Algorithms, Foundations, and Applications B
SBBD Brazilian Symposium on Databases B
SCAI Scandinavian Conference on Artifical Intelligence B
SCRAA Smart Card Research and Advanced Application Conference B
SCSC Summer Computer Simulation Conference B
SEAL Asia-Pacific Conference on Simulated Evolution & Learning B
SEC IFIP International Information Security Conference B
SECON IEEE Conference on Sensor, Mesh and Ad Hoc Communications and Networks B
SecureComm IEEE/CreateNet International Conference on Security and Privacy in Communication Networks B
SECURITY Usenix Security Symposium B
SEEP International Conference on Software Engineering: Education and Practice B
SEFM International Conference on Software Engineering and Formal Methods B
SEKE International Conference on Software Engineering and Knowledge Engineering B
SEQAPP International Conference on Sequences and their Applications B
SIGCHI-NZ International NZ Conference on Computer-Human Interaction B
SIGOPS-EW ACM SIGOPS European Workshops B
SIROCCO Colloquium on Structural Information and Communication Complexity B
SMC IEEE Conference on Systems, Man and Cybernetics B
SOFTCOMM Conferenceon Software in Tcomms and Comp Networks B
SoMeT International Conference on Software Methods and Tools B
SPEC Workshop on Security and Privacy in E-commerce B
SPICIS Singapore International Conferenceon Intelligent System B
SPIRE International Symposium on String Processing and Information Retrieval B
SST Australasian Speech Science & Technology B
STEP Software Technology and Engineering Practice Conference B
SWDC International Conference on Software Development B
TOOLS Technology of object-oriented languages and systems B
UKAIS UK Academy of Information Systems conference B
UKSS United Kingdom Systems Society B
UMC Unconventional Models of Computation B
UML Unified Modelling Language B
VAPP Vector and Parallel Processing B
VDB Visual Database Systems B
VEE International Conference on Virtual Execution Environments B
VTC IEEE Vehicular Technology Conference B
WABI Workshop on Algorithms in Bioinformatics B
WAE Workshop on Algorithm Engineering B
WAIS International Workshop on Artificial Intelligence and Statistics B
WCES World Congress on Expert Systems B
WCNC IEEE Wireless Communications and Networking Conference B
WCNN World Congress on Neural Networks B
WCRE IEEE Working Conference on Reverse Engineering B
WCSS World Congress on Systems Simulation B
WCW Web Caching Workshop B
WDAG Workshop on Distributed Algorithms (DISC since 1998) B
WG Workshop on Graph Theory B
WI IEEE/WIC/ACM International Conference on Web Intelligence B
WiOpt International. Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks B
WoLLIC Workshop on Logic, Language, Information and Computation B
WORDS International Workshop on Object-Oriented Real-Time Dependable Systems B
WSC Winter Simulation Conference B
AdCom International Conference on Advanced Computing and Communications C
AEN IASTED International Conferenceon AI, Exp Sys & Neural Networks C
AI IASTED International Conference on Applied Informatics C
AIA Artificial Intelligence and Applications Conference C
AIL International Conference on Artificial Intelligence and Law C
AIS Advances in Intelligent Systems C
AIS SIGED:IAIM International Academy for Information Management) International Conference on Informatics Education & Research C
AISAT International Conference on Artificial Intelligence in Science and Technology C
AMAST Algebraic Methodology and Software Technology C
ANNES Conference on Artificial Neural Networks and Expert systems C
APCOMin Application of Computers and Operations Research in the Minerals Industries C
APORS Conference of the Association of Asian-Pacific Operational Research Societies C
APPIA/GULP/PRODE Joint Conference on Declarative Programming APPIA-GULP-PRODE C
AQSDT Symposium on Assessment of Quality S/W Dev Tools C
ARTDB Active and Real-Time Database Systems C
ARVLSI Advanced Research in VLSI C
ASC IASTED International Conference on Artificial Intelligence and Soft Computing C
ASM IASTED International Conference on Applied Simulation and Modelling C
BC IFIP International Conference on Broadband Communications C
BECC Bled Electronic Commerce Conference C
BIBE IEEE Bioinformatics and Bioengineering C
CAADRIA Conference on Computer Aided Architectural Design Research in Asia C
CAINE ISCA International Conference on Computer Applications in Industry and Engineering C
CATA International Conference on Computers and their Applications C
CATE IASTED International Conference on Computers and Advanced Technology in Education C
CCRTS International Command and Control Research and Technology Symposium C
CCTAF Intelligent Multimedia, Computing and Communications Technologies and Applications of the Future C
CDB Constraint Databases and Applications C
CHPC International Conference on High Performance Computing C
CIBCB IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology C
CIEAEM Conference of the Commission Internationale pour l’Etude et l’Amelioration de l’Enseignement des Mathematiques C
CIMCA International Conference on Computational Intelligence for Modelling, Control and Automation C
CIRSYS International Symposium on Circuits and Systems C
CISST International Conference Image Science, Systems and Technology C
CODAS International Symposium on Cooperative Database Systems for Advanced Applications C
CollECTeR Collaborative Electronic Commerce Technology and Research C
COMPDES International Symposium on Computer Design C
COMSWARE te-Net/ICST International Conference on COMmunication System softWAre and MiddlewaRE C
CPD Constraint Programming Day C
CryPAC Cryptography Policy and Algorithms Conference C
CSEE Conference on Software Engineering Education C
CSICC International CSI Computer Conference C
CTAC Computational Techniques and Applications Conference C
CxS International Conference on Complex Systems C
DASD Symposium on Design, Analysis, and Simulation of Distributed Systems C
DASWIS Data Semantics in Web Information Systems C
DBPL Databases and Programming Language C
Dcw Distributed Communities on the Web Workshop C
DICTA/IVCNZ Joint DICTA & IVCNZ C
DMDW Design and Management of Data Warehouses C
DMKD Workshop on Research Issues in Data Mining and Knowledge Discovery C
DOLAP International Workshop on Data Warehousing and OLAP C
DSAA International Conference on Database Systems for Advanced Applications C
DSI Annual Meeting of the Decision Sciences Institute C
DSLSE Domain - Specific Languages for Software Engineering C
DSTKM International Conference on Decision Support Through Knowledge Management C
DTVE Workshop on Database Technology for Virtual Enterprises C
DVAT Information Systems &Technologies /SPIE Conference on Digital Video Compression Algorithms & Techniques C
EFIS/EFDBS Engineering Federated Information (Database) Systems C
EFTF/IFCS Joint Meeting of the European Frequency and Time Forum and the Institute of Electrical and Electronics Engineers In C
EICAR European Institute for Computer Anti-Virus ResearchEICAR Conference C
EKM European Conference on Knowledge Management C
EMBC The Annual International Conference of the IEEE Engineering in Medicine and Biology Society C
EMCIS European Mediterranean Info Systems C
EP Annual Conference on Evolutionary Programming C
ESCAPE Symposium On Combinatorics, Algorithms, Probabilistic and Experimental Methodologies C
ETHICOMP International Conference on the Social and Ethical Impacts of Information and Communication Technologies C
EUFIT European Congress on Intelligent Techniques and Soft Computing C
EuroBot European Workshop on Advanced Mobile Robots C
EWCG European Workshop on Computational Geometry C
FATES A Satellite workshop on Formal Approaches to Testing of Software C
FIRA FIRA Robot World Congress C
FMICS Int. Workshop on Formal Methods for Industrial Critical Systems C
FMOOD International Conference on Formal Methods for Open Object-Based Distributed Systems C
FMP Formal Methods Pacific C
FMSEDS Formal Methods in Software Engineering and Defence Systems Workshop C
FOOL International Workshop on Foundations of Object-Oriented Languages C
FQAS Flexible Query-Answering Systems C
FTJP Workshop on Formal Techniques for Java Programs C
FUSION International Conference on Information Fusion C
GeoComp International Conference on GeoComputation C
GOR Conference on Operations Research C
HASKELL Haskell Workshop C
HCI International Conference on Human-Computer Interaction C
HealthCom International Workshop on Enterprise Networking and Computing in Health Care Industry C
HIC Health Informatics Conference C
HLPP International workshop on High-level parallel programming and applications C
HPC International Conference and Exhibition on High Performance Computing in the Asia-Pacific Region C
IADIS AC IADIS International Conference Applied Computing C
IAIF International Workshop on Image Analysis and Information Fusion C
IAIM Annual Conference of the International Academy for Information Management C
IAS IEEE Industry Applications Society Annual Conference C
IAT ACM International Conference on Intelligent Agent Technology C
IAWTIC International Conference on Intelligent Agents, Web Technologies, and Internet Commerce C
IBIMA International Business Information Management C
IC International Conference on Internet Computing C
ICA IFAC Conference on Automation C
IC-AI International Conference on Artificial Intelligence C
ICANNGA International Conference on Artificial Neural Networks and Genetic Algorithms C
ICAPRDT International Conference on Advances in Pattern Recognition and Digital Techniques C
ICCIMA International Conference on Computational Intelligence and Multimedia Applications C
ICCIT International Conference on Computer and Information Technology C
ICCSA International Conference on Communication Systems and Applications C
ICEB International Conference on e-Business C
ICEC IEEE International Conference on Evolutionary Computation C
ICEComm International Conference on Electronic Commerce C
ICEE International Conference on Engineering Education C
ICIL International Conference on Intelligent Systems C
ICITA International Conference on Information Technology and Applications C
ICMSO International Conference on Modelling, Simulation and Optimisation C
ICOTA International Conference on Optimization: Techniques And Applications C
ICSRIC International Conference on Systems Research, Informatics and Cybernetics C
ICSSEA International Conference “Software and Systems Engineering and their Applications” C
ICTT International Conference on Information and Communication Technologies in Tourism C
ICVS International Conference on Virtual Storytelling C
IDC IEEE Conference on Information, Decision and Control C
IDEAL International Conference on Intelligent Data Engineering and Automated Learning C
IDFC IDF Congress C
iEMSs Intenational Environmental Modelling and Software Society C
IFAC International Federation of Automatic Control World Congress C
IGARSS IEEE International Geoscience and Remote Sensing Symposium C
IICISA International ICSC Congress on Intelligent Systems and Applications C
IICS Innovative Internet Computer Systems C
IIWAS Information Integration and Web-based Applications and Services C
IMSA IASTED International Conference on Internet, Multimedia Systems and Applications C
INAP International Conference on Applications of Prolog C
Interspeech Interspeech C
IPMU International Conference on Information Processing and Management of Uncertainty C
IPS IEEE International Conference on Intelligent Processing Systems C
IPythC International Python Conference C
IRITA International Information Technology in Regional Areas Conference C
ISAS-SCI World Multiconference on Systemics, Cybernetics and Informatics C
ISAVIIA International Symposium on Audio, Video, Image Processing and Intelligent Applications C
ISC IASTED International Conference on Intelligent Systems and Control C
ISDSS Conference of the International Society for Decision Support Systems C
ISECON Information Systems Education Conference C
ISFST International Symposium on Future Software Technology C
ISIMP International Symposium on Intelligent Multimedia, Video and Speech Processing C
ISITA IEEE International Symposium on Information Theory and Its Applications C
ISORC IEEE International Symposium on Object-Oriented Real-Time Distributed Computing C
I-SPAN International Symposium on Parallel Architectures, Algorithms and Networks C
ISSA International Symposium on Static Analysis C
ISSDI International Symposium on Spatial Data Infrastructures C
ISSDQ International Symposium on Spatial Data Quality C
ISSS International Symposium on System Synthesis C
ISW Information Security Workshop C
ITHET International Conference on IT Based Higher Education and Training C
ITiRA Information Technology in Regional Areas Conference C
ITIS Symposium on Information Technology and Information Systems C
ITW IEEE Information Theory Workshop on Detection, Estimation, Classification and Imaging C
IWC International Web conference C
IWCC IEEE International Workshop on Cluster Computing and the Grid C
IWDOM International Workshop on Distributed Object Management C
IW-MMDBMS Int. Workshop on Multi-Media Data Base Management Systems C
JCIS Joint Conference on Information Sciences C
JECGI Joint European Conference and Exhibition on Geographical Information C
JFPLC International French Speaking Conference on Logic and Constraint Programming C
JHPC Workshop On Java For High-Performance Computing C
JURIX International Conference on Legal Knowledge-based Systems C
KAW Knowledge Acquisition, Modeling and Management Workshop C
KDDMBD Knowledge Discovery and Data Mining in Biological Databases Meeting C
KDEEW IEEE Knowledge and Data Engineering Exchange Workshop C
KDEX Knowledge and Data Engineering Exchange Workshop C
KRDB Knowledge Representation Meets Databases C
L&L Workshop on Logic and Learning C
LANMAN IEEE LAN/MAN Workshop C
LARC NASA LaRC Formal Methods Workshop C
LawTech IASTED International conference Law and Technology C
LCCS International Workshop on Logic and Complexity in Computer Science C
LI Law via the Internet C
LOCALGOS Workshop on Localized Alg. and Protocols for Wireless C
LREC Language Resources and Evaluatin Conference C
MDDS Mobility in Databases and Distributed Systems C
MDSRIA International Workshop on Multimedia Data Storage, Retrieval, Integration and Applications C
METRICS (several conferences of these name - can’t rank) C
MEWS Mining for Enhanced Web Search C
MIC IASTED International Conference on Modelling, Identification, and Control C
MME IEEE International Conference on Multimedia in Education C
MobiDE Workshop on Data Engineering for Wireless and Mobile Access C
MODSIM International Congress on Modelling and Simulation C
MODSS Multiple Objective Decision Support System Conference C
MPOOL Workshop on Multiparadigm Programming with OO Languages C
MS IASTED International Conference on Modelling and Simulation C
MSO IASTED International Conference on Modelling, Simulation and Optimization C
MTNS International Symposium on the Mathematical Theory of Networks and Systems C
MVSP Intelligent Multimedia, Video and Speech Processing Symposium C
NAFIPS North American Fuzzy Information Processing Society Conference C
NAISO NAISO Congress on Autonomous Intelligent System C
NCA ? C
NCCIS National Conference on Computer and Information Systems C
NDB National Database Conference (China) C
NeMLaP Joint Conference on New Methods in Language Processing and Computational Natural Language Learning C
NFM The Northern Formal Methods Workshops C
NHIC National Health Informatics Conference C
NLDB Applications of Natural Language to Data Bases C
NNSP IEEE International Workshop on Neural Networks for Signal Processing C
NPDP Annual IASTED International Conference on Networks, Parallel and Distributed Processing and Applications C
NPSC International Conference on Neural, Parallel and Scientific Computations C
NRDM Workshop on Network-Related Data Management C
OASIS Organisations and Society in Information Systems Workshop C
OESS/IOCC/ACOFT Joint OECC, IOCC & ACOFT C
OODBS Workshop on Object-Oriented Database Systems C
OOIS International Conference on Object Oriented Information Systems C
ORPA Conference on Operational Research Practice in Africa C
OTA Optimization: Techniques And Applications C
P&I PACES & ICIL C
PAAM Practical Application of Intelligent Agents and Multi-Agent Technology Conference C
PADO Symposium on Programs as Data Objects C
PAP/PACT Practical Aspects of PROLOG/Constraint Technology C
PARCO Parallel Computing C
PAWEC Pacific-Asia Workshop on Electronic Commerce C
PCNS SPIE - Conference on Performance and Control of Network Systems C
PCS International Picture Coding Symposium C
PCW International Parallel Computing Workshop C
PDCN IASTED International Conference on Parallel and Distributed Computing and Networks C
PDCS IASTED International Conference on Parallel and Distributed Computing and Systems C
PDIS Parallel and Distributed Information Systems C
PDP International Parallel and Distributed Processing Symposium C
PDPTA International Conference on Parallel and Distributed Processing Techniques and Applications C
PEC&CON Joint AUPEC & EECON C
PHYSDES International Symposium on Physical Design C
PMIP IEEE Pacific-Rim Conference on Multimedia C
PPCIS Pan Pacific Conference on Information Systems C
PSB Pacific Symposium on Biocomputing C
PSOR International Conference on Probability, Statistics and Operational Research C
PTPC International Workshop on Practice and Theory in Public-Key Cryptography C
QuantCom International Conference on Experimental Implementation of Quantum Computation C
RFF International Conference on CAD/CAM, Robotics & Factories of the Future C
RM IASTED International Conference on Robotics and Manufacturing C
ROVPIA International Conference on Robotics C
RS Annual Convention for Survey, Mapping and Remote Sensing C
RTDB Workshop on Real-Time Databases C
SARC International Symposium on Automation and Robotics in Construction C
SCW IEEE Workshop on Speech Coding C
SE IASTED International Conference on Software Engineering C
SEA IASTED International Conference on Software Engineering and Applications C
SECRYPT International Conference on Information Security and Cryptology C
SEET Software Engineering Education and Training Conference C
SELCRYP Annual Workshop on Selected Areas in Cryptography C
Sensor Networks Sensor Networks C
SFP Scottish Functional Programming Workshop C
SimTecT Simulation Technology and Training Conference C
SInT IEEE International Symposium on Information Theory C
SIP IASTED International Conference on Signal and Image Processing C
SIRC Spatial Information Research Centre Colloquium C
SIST Spatial Information Science and Technology Conference C
SITE Society for Information Technology and Teacher Education Conference C
SPDS ACM Symposium on Principles of Database Systems C
SQC Software Quality Conference C
SQM International Conference on Software Quality Management C
SREIS Symposium on Requirements Engineering for Information Security C
SRIG-ET Software Education Conference C
SSC IFAC Conference on System Structure and Control C
SSGRR International Conference on Advances in Infrastructure for Electronic Business, Science, and Education on the Internet C
SSS Symposium on Stabilization, Safety, and Security of Distributed Systems C
STM International Conference on Systems Thinking in Management C
SYSSYN International Symposium on System Synthesis C
TAKMA Theory and Applications of Knowledge MAnagement C
TE International Conference on Technology Education C
TENCON IEEE Region Ten Conference C
TIDSE Technology for Interactive Digital Storytelling C
VDbS IFIP Working Conference on Visual Database Systems C
VDEA SPIE Conference on Visual Data Exploration and Analysis C
VIIP IASTED International Conference on Visualization, Imaging, and Image Processing C
VIP Pan-Sydney Area Workshop on Visual Information Processing C
VISUAL International Conference on Visual Information Systems C
VLFM Visual Languages and Formal Methods C
VLSID International Conference on VLSI Design C
VSMM International Conference on Virtual Systems and MultiMedia C
W2GIS International Workshop on Web and Wireless Geographical Information Systems C
WAIM Interational Conference on Web Age Information Management C
WALCOM Workshop on Algorithms and Computation C
WAW Workshop on Algorithms and Models for the Web-Graph C
WCC World Computer Congress C
WCCE World Conference on Computers in Education C
WDSI Western Decision Sciences Institute Conference C
WebDB International Workshop on the Web and Databases C
WEBIST International conference on Web Information Systems and Technologies C
WebNet World Conference on the WWW and Internet C
WEC International Workshop on Entertainment Computing C
WFLP International Workshop on Functional and (Constraint) Logic Programming C
WHIS Workshop on Hybrid Intelligent Systems C
WICS International Computer Symposium Workshop C
WIDM ACM Workshop on Web Information and Data Mangement C
WMSCI World Multiconfs on Systems, Cybernetics & Informatics C
WoPP IEEE International Conference on Parallel Processing Workshops C
WORLDCOMP World Congress in Computer Science, Computer Engineering, and Applied Computing C
WTASA Workshop on Theoretical and Algorithmic Aspects of Sensor and Ad-hoc Networks C
WWCA International Conference on Worldwide Computing and Its Applications C
ZB International Conference of Z and B Users C
ZUM International Conference of Z Users C
ZUSER International Conference of Z Users C
Informatics in Education (journal, congress, symposium, etc all under this name - can’t rank) C
ACAC Australasian Computer Architecture Conference L
ACCMCC Australasian Conference on Combinatorial Mathematics and Combinatorial Computing L
ACEC Australasian Computers in Education Conference L
ACID Algorithms and Complexity in Durham L
ACKMIDS Australian Conference for Knowledge Management and Intelligent Decision Support L
ACMA Australasian Computer Music Conference L
ACNN Australian Conference on Neural Networks L
ACSSC Asilomar Conference on Signals, Systems and Computing L
AFETE Asia-Pacific Forum on Engineering and Technology Education L
AICE Australian Institute of Computer Ethics Conference L
AICEC AICEC Conference L
AJWIES Australia-Japan Joint Workshop on Intelligent and Evolutionary Systems L
AKAW Australian Knowledge Acquisition Workshop L
ANZMODS The Modelling and Simulation Society of Australia and New Zealand Meeting L
APCHDL Asia Pacific Conference on Hardware Description Languages L
APDSI Asia Pacific Decision Science Institute Conference L
APRTS Australasian Conference on Parallel and Real-Time Systems L
APSEC/ICSC Asia-Pacific Software Engineering Conference and International Computer Science Conference L
ARSC Australasian Remote Sensing Conference L
ASCILITE Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education L
ASDAC Asia Pacific Design Automation Conference L
ASIV Australian Symposium on Information Visualisation L
ASOR National Conference of The Australian Society for Operations Research L
ATNAC Australian Telecommunication Networks and Applications Conference L
AUCADC Apple University Consortium Academic & Developers Conference L
AuCSS Australasian Cognitive Science Society Conference L
AURISA Australasian Urban and Regional Information Systems Association Conference L
AuRW Australasian Refinement Workshop L
AusWeb Australian World Wide Web Conference L
AUUG Australian UNIX Users Group National Conference L
AUUG/APWEB Joint Australian Unix Users’ Group and Asia Pacific World Wide Web Conference L
AWOCA Australasian Workshop on Combinatorial Algorithms L
AWSA Australian Workshop on Software Architecture L
BCS-FMW British Computer Society Formal Aspects of Computing Science Specialist Group Workshop L
CanaDAM Canadian Discrete and Algorithmic Mathematics Conference L
CEG Computing in Education Group of Victoria Conference L
COMPUMOD Australasian Compumod Users’ Conference L
CSR Computer Science Symposium in Russia L
DITAM Doing IT at Melbourne L
DIVC Joint Australia and New Zealand Biennial Conference on Digital Image and Vision Computing L
FlAIRS Florida Artificial Intelligence Research Society Conference L
GCCCE Global Chinese Conference on Computers in Education L
ICCC International Conference on Chinese Computing L
ICTCS Italian Conference on Theoretical Computer Science L
IDC(W) International Database Conference (HK CS) L
IDEAW Integrated Data Environments Australia Workshop L
INDOCRYPT International Conference on Cryptology in India L
MADYMO Australian MADYMO Users Meeting L
MATLAB Australian MATLAB Conference L
MCDA Australian Workshop on Mobile Computing, Databases and Applications L
MCSpo Australian Conference on Mathematics and Computers in Sport L
MICC/ISPACS Joint IEEE Malaysia International Conference on Communications and IEEE International Workshop on Intelligent Signal Processing and Communication Systems L
NACCQ National Advisory Committee on Computing Qualifications L
NORDSEC Nordic Workshop on Secure IT Systems L
ODLA Open and Distance Learning Association of Australia Bienniel Forum L
PACCS Post-Graduate ADFA Conference on Computer Science L
SCSS Australian Workshop on Safety Critical Systems and Software L
UWACS University of Western Australia Computer Science Research Conference L
WarSec Australian Information Warfare & Security Conference L
WAWISR Western Australian Workshop on Information Systems Research L
WIC Australasian Women in Computing Workshop L

Survey of Controllable Text Generation

CTG 的定义

  • better meet the specific constraints in practical applications
  • Controllable text generation (CTG) refers to the task of generating text according to the given controlled element

image-20231127212726619

举例说明

  • 第一个例子就是给定一个故事线,要求模型按照这样的思路去生成。
  • 第二个例子是关于传统人机对话中如果机器生成文本时不受控制可能带来的问题,比如会给出有害的建议,甚至说脏话,这个时候就需要我们在模型生成的时候加以控制。

跟传统NLG的区别就在于我们会在输入的时候加入某些控制因素,从而让最终的输出满足某种条件。

CTG的应用场景

  • Attribute-based Generation,基于某种属性的自然语言生成,比如生成特定情感/口吻/风格的文本
  • Dialogue Generation,对话系统对NLG有更高的要求,因此CTG的应用就不言而喻了
  • Storytelling,用CTG来辅助文学创作,想想就很爽,而传统的NLG,基本给了开头你就无法控制了
  • Data to Text,使用一些结构化数据(table,graph)来生成自然语言,可用于给定每天的天气数据,来自动生成天气播报,或者把老板看不懂的表格数据用CTG技术翻译成人话给他听
  • Data Augmentation,使用CTG可以把已有的文本的某些信息给重新生成,变成我们想要的属性
  • Debiasing,这也非常重要,可以帮助我们把带有某些偏见的文本转化成无偏见的文本,让机器也符合伦理道德
  • Format Control,风格、格式的转换,比如中国古诗词就有明确的格式,这就需要在生成的时候加以控制

CTG的方法流派

image-20231127213100182

大致上分为三类:

  • 改良派:在已有PLM的基础上继续预训练
  • 革命派:另起炉灶,重新训练一个大型预训练模型
  • 保守派:连PLM都不想动,直接在PLM的输出上做后处理

1. FineTuning

改良派,实际上就是沿用了PLM最经典的使用方法——Fine-tuning,虽然原始的PLM在训练的时候,并没有对某些属性、特点、要素进行控制,但是PLM预训练中学习的大规模知识是很有用的,所以我们使用特定的语料,让PLM进一步去学习我们希望的某种控制效果,就可以实现CTG的目的。

而Finetuning中又分为三种方式:

  • Adapted Module方式,通过额外添加一个控制模块,用于添加属性控制,然后连同PLM一起进行训练。代表方法包括 Auxiliary Tuning[2],DialGPT[3]。
  • Prompt方式,包括prompt Learning、prompt tuning[4]等方法,实际上基于prompt的方法,本身就是对PLM的生成加入了额外的控制,如果使用有监督的风格、属性数据集进行训练,就可以直接得到基于prompt的CTG模型。也有更新的工作Inverse Prompt[5],用模型生成的句子来反过来去预测代表风格、主题等的prompt,从而让prompt对文本生成的控制力更强。
  • 基于强化学习RL的方法。
  • 指令微调, 构造指令数据集 进行有监督微调训练

这些基于finetuning的方法,基本都要求我们有一个下游任务的有监督数据集,从而帮助我们学习某种控制性,比如你希望控制生成文本的情感属性,那么就需要你有情感分类的数据集,让模型去学习[指定情感]——>[该情感的文本]的映射。

2. Retrain/Refactor

  1. CTRL

    CTRL收集了140GB的数据,涵盖了很多个domain的语料(百科、reddit、影评、新闻、翻译、问答…),每个domain都设置有一个control code,从而训练一个大型的包含1.63B参数量的conditional language model, 那些control code是预定义好的,直接插入在sequence的开头

  2. Content-Conditioner (CoCon)

    以CTRL为代表的方法只能从一个总体的层面对生成文本增加限制,比如某种风格主题,但无法对具体内容进行精细控制,CoCon则是直接以原文中的部分内容作为condition,来预测下文, 核心思想就是使用文本的一部分作为condition,让模型对剩余部分进行复原

image-20231127215815938

上面列举的CTRL和CoCon的对NLG添加的实际上是比较soft的限制,并不强制要求模型一定要输出什么元素,而有一些工作则会使用hard的限制,要求模型必须输出给定的某些关键词:

  1. POINTER

    POINTER的主要目的是训练根据指定词汇然后生成包含这些词汇的模型,采用的是一种基于插入的、渐进生成的方法,POINTER的生成是一种迭代式地生成,先生成给定的关键词,然后每一轮都按照重要性不断插入新的词,直到把句子给补齐。POINTER中使用的一种Transformer结构叫做Insertion Transformer

    image-20231127220156236
  2. Constrained BART (CBART)

    对BART进行了改造,通过在encoder上面添加一个token-level classifier来指导decoder在生成的时候应该进行replace还是insert

3. Post-Process

  1. Plug and Play Language Models (PPLM)

    PPLM不希望去训练PLM,而是通过额外的一个attribute model来对PLM的输出加以修正,从而符合某种预期。这里的attribute model,既可以是一个bag of words来代表某个topic,也可以是一个训练好的小模型来对某个topic进行打分,然后通过这个attribute model向PLM的hidden states传递梯度,从而对hidden states进行一定的修正,然后PLM的输出就会往我们希望的topic倾斜了。

    image-20231127220849538
  2. MEGATRON-CNTRL

    选择利用外部知识库来辅助生成,给定一个context,MEGATRON-CNTRL会首先使用一个predictor生成一批关键词,然后通过一个retriever从知识库中找到跟这些关键词匹配的句子,然后通过一个ranker进行筛选,最后再输入PLM进行句子的生成:

还有工作比如PAIR[14]则是先生成一个包含关键词和位置信息的模板,然后对模板进行填空,从而进行控制性生成;GeDi[15]则是训练一个小型的discriminator来引导PLM的生成。

image-20231127221138206

大模型可用数据集

  1. huggfaceing数据集仓库: https://huggingface.co/datasets
  • 包含了自然语言处理、计算机视觉、语音、多模态等数据集,内置100多个多语言公共数据集下载
  1. ModelScope数据集仓库:https://modelscope.cn/datasets
  • 提供了覆盖自然语言处理、计算机视觉、语音、多模态等数据集,更有阿里巴巴集团贡献的专业领域数据集,
  1. flagopen数据集仓库: https://data.baai.ac.cn/data
  • 内置公共数据集下载,可下200G大规模预训练语料WuDaoCorpora
  1. cluebenchmarks数据集仓库:https://www.cluebenchmarks.com/dataSet_search.html
  • 多个中英文NLP数据集,并可申请下载100GB的高质量中文预训练语料CLUECorpus2020
  1. MNBVC: Massive Never-ending BT Vast Chinese corpus
  • 超大规模中文语料集
  1. OpenDataLab数据集仓库: https://opendatalab.com/
  • OpenDataLab 是有影响力的数据开源开放平台,公开数据集触手可及。
  1. OSCAR: Open Super-large Crawled Aggregated coRpus, 多语言数据集
  • 最新版本包含1.4T的中文语言数据集
  1. Gutenberg:免费的英文电子书
  • Project Gutenberg is a library of over 70,000 free eBooks

垂直领域可用数据

  1. 军迷窝
  2. 星河搜索
  3. 占知文库
  4. 军事网站汇总
  5. 简氏防务周刊
  6. 水墨芋
  7. 武器装备数据库
  8. 百度网盘
  9. 军队指挥学科知识大数据平台
  10. 国防军事门户网站

中文微调指令数据集

名称 大小 语言 下载 作者 项目地址 时间 备注
Bactrian-X 67K 多语言 dataset MBZUAI bactrian-x 2023-05
CrimeKgAssitant 52k 中文 dataset hongchengliu LAW-GPT 2023-05 中文法律
moss-002-sft-data 1.1M 中英文 dataset 复旦大学 MOSS 2023-04
moss-003-sft-data 1.1M 中英文 dataset 复旦大学 MOSS 2023-04
moss-003-sft-plugin-data 300K 中英文 dataset 复旦大学 MOSS 2023-04
Safety-Prompts 100K 中文 dataset 清华大学 Safety-Prompts 2023-04 评测平台
OASST1 / 多语言 dataset OpenAssistant Open-Assistant 2023-04
ShareChat 90K 中英文 dataset czhko 2023-04
GPT-4-LLM 52K 中文 dataset Instruction-Tuning-with-GPT-4 GPT-4-LLM 2023-04 paper
COIG 200K 中文 dataset BAAI FlagInstruct 2023-04 paper
RedGPT 50k 中文 dataset MiniGPT RedGPT 2023-04
shareGPT_cn 20k 中文 dataset shareAI shareGPT_cn 2023-04
generated_chat_0.4M 0.4M 中文 dataset Ke Technologies BELLE 2023-04 个性化角色对话数据
multiturn_chat_0.8M 0.8M 中文 dataset Ke Technologies BELLE 2023-04 多轮任务对话
school_math_0.25M 0.25M 中文 dataset Ke Technologies BELLE 2023-04 中文数学题数据
Zhihu-KOL / 中文 dataset Rui Wang Zhihu-KOL 2023-03
InstructionWild 104k 中英文 dataset Xue Fuzhao InstructionWild 2023-03
Alpaca-CoT /. 中英文 dataset Qingyi Si Alpaca-CoT 2023-03 内置多个数据集(推荐)
GuanacoDataset / 中/多语言 dataset Guanaco guanaco-model 2023-03
Traditional-Chinese-alpaca 52K 中文 dataset NTU NLP Lab Traditional-Chinese Alpaca 2023-03 gpt翻译
alpaca_chinese_dataset / 中文 dataset akou alpaca_chinese_dataset 2023-03 人工校验
alpaca-chinese-dataset / 中文 dataset carbonz alpaca-chinese-dataset 2023-03 机器翻译
train_2M_CN 2M 中文 dataset Ke Technologies BELLE 2023-03
train_1M_CN 1M 中文 dataset Ke Technologies BELLE 2023-03
train_0.5M_CN 0.5M 中文 dataset Ke Technologies BELLE 2023-03
HC3 人类-ChatGPT 问答 / 中文 dataset SimpleAI chatgpt-comparison-detection 2023-03
firefly-train-1.1M 1.1M 中文 dataset Jianxin Yang Firefly 2023-03

Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond(paper)

perspectives of models, data, and downstream tasks

  1. introduction and brief summary of current GPT- and BERT-style LLMs

    differ in training strategies, model architectures, and use cases. image(Summary of Large Language Models)

    Transformer-based models, encoder-decoder models, encoder-only language models and decoder-only language models image (evolutionary tree of modern LLMs)

    from above two image, four ideas:

    a) decoder-only model became dominating of LLM;

    b) openai maintains its leadership of LLM;

    c) Meta open-source their LLM;

    d) closed-source tendency of LLM and so API-based rsearch will become the predominant method;

    e) encoder-decoder based-model remain promising.

    1.1 BERT-style Language Models: Encoder-Decoder or Encoder-only

    need big data -> unsupervised training -> masked train method and surrounding context -> MLMs advantages: deeper understanding of the relationships between words and the context -> BERT, RoBERTa, T5.

    1.2 GPT-style Language Models: Decoder-only

    bigger model better performance -> autoregressive language model (given a word generate latter words) -> these model use data about downstream tasks, examples:GPT3, OPT, PaLM, BLOOM -> GPT3 with prompting and in-context learning( prompt with little labeled data) -> examples: CodeX for code generation, BloombergGPT for financial domain, chatgpt for conversational tasks.

  2. influence of pre-training data ,training data, and test data

  3. discussion about the use and non-use cases of LLM for various NLP tasks

  4. examples of the successful use cases and the limitations of LLMs in practice.

理解大语言模型——10篇论文的简明清单

attention mechanism -> transformer(from paper Attention Is All You Need) -> BERT(encoder only) -> GPT (decoder only) -> BART(encoder-decoder) -> Linear Scaling Law for under-training problem( better data with smaller model is better than less data with bigger model) -> Reinforcement Learning with Human Feedback ,RLHF

some LLM for downstream task( all about biology):

  1. ProtTrans : LLM for Life’s Code
  2. AlphaFold: Protein Structure Prediction
  3. Large Language Models Generate Functional Protein Sequences Across Diverse Families

A Survey of Large Language Models

  1. background

    pre-trained model -> LLM(complicated engineering issues)

  2. key findings

  3. mainstream techniques

大模型相关技术综述

  1. LLM history

    word2vec -> elmo(word embedding) -> transformer

  2. mainstream architecture

    bert style, bert and gpt style, gpt style

大语言模型调研汇总

  1. Basic Language Model

GPT-style 表示 decoder-only 的自回归语言模型,T5-style 表示 encoder-decoder 的语言模型,GLM-style 表示 GLM 特殊的模型结构,Multi-task 是指 ERNIE 3.0 的模型结构

当前绝大部分的大语言模型都是 Decoder-only 的模型结构, 大部分大语言模型都不开源

  1. Instruction-Finetuned Language Model

Instruction(指令)是指通过自然语言形式对任务进行描述

探索大语言模型垂直化训练技术和应用

  1. 参数规模和数据规模的探索

    缩放法则 (Scaling Laws): more parameters, more data, more loops, less loss

    Compute-Optimal: 语言模型训练数据大小,应该和模型参数量大小等比放大

    Open and Efficient: 百亿模型的潜力仍有待深入挖掘

    数据规模存在瓶颈 :开放数据即将耗尽

    选择最合适的训练数据: 正确的训练数据对提升某些能力有重要效果,“对症下药”很关键,未来在垂直领域任务中可能存在优化空间。

  2. 垂直领域适应预训练

    • 先用大规模通用语料预训练,再用小规模领域语料二次训练

    • 直接进行大规模领域语料预训练

      一个医学领域的代表模型 PubMedGPT 2.7 B。一个是金融领域 BBT-FinT5 模型。它们的参数规模都不大,但是这些用垂直领域的数据做的专用训练,它的效果比参数规模更小一点的小模型来说有非常明显的提升。另外,和相同规模通用大规模的 Finetune 相比,垂直领域大模型的效果仍然是领先的。

      因此,路线二是一个性价比非常高的方案,它用到的参数规模并不大,但在垂直领域的效果不错。同时,垂直领域大模型所用资源会比通用大模型少很多,并且和超大规模模型在垂直领域的效果是接近的,这种方式也给我们开启了一些尝试的空间。

      应用了知识增强技术的领域大模型在领域任务上的效果, 好于领域小模型和通用大模型。所以这可能是一条值得去探索的中间道路,是一种垂直领域比大模型要略小一点,但比小模型要大的中间态的模型。

    • 通用语料比例混合领域语料同时训练

  3. 提示 Prompt 垂直优化

    1. 一种是产品化思路。产品化的是请垂直领域的专家,针对每项垂直任务,来设计用于生成 prompt 的产品,由专家编写大量不同的 prompt,评估或输出好的 prompt 后,进行片段切分,形成相应的产品,这对未来 AIGC 任务会起到很好的作用。
    2. 另一种是自动化的思路,通过借过外部工具,或通过自动化的流程方法和训练方式,对 Prompt 进行自动优化。
  4. 模型功能的垂直效能增强

    • CoT 增强
    • use other models
    • 使用垂直知识库
    • 使用搜索引擎
    • 内容转换
    1. 多语言模型
    2. 参数小不代表模型效果就差
    3. chat base model or base model
    4. 专注垂直领域的话 也不一定追求大
    1. ==LLaMA OPT==:用的人很多,模型的参数和数据量对应,模型很扎实 Meta

    2. BLOOM:参数量大 BigScience (非盈利兴趣组织)

    3. GPT-NEO:EleutherAI发布的,名头很响亮

    4. GLM: 清华推出的 对中文支持较好(网传效果很差

垂类大模型技术落地

  1. Character.AI

    Character.AI 专注于 UGC 的个性化聊天机器人,从模型的开发,训练,到数据的收集,终端应用整条价值链。值得关注的是,Character.AI 开发了自己的类似于 GPT 的 Pre-trained 模型,这种 Pre-trained 模型拥有高效的 LLM 推理算法,推理成本远远低于 ChatGPT

  2. 毫末智行

    毫末智行专注于自动驾驶认知大模型,旗下的 DriveGPT 模型参数达到了 1200 亿,通过引入量产驾驶数据,训练初始模型,再通过引入驾驶接管 Clips 数据完成反馈模型 (Reward Model) 的训练,然后再通过强化学习的方式,使用反馈模型去不断优化迭代初始模型,形成对自动驾驶认知决策模型的持续优化

  3. Bloomberg

    大名鼎鼎的 Bloomberg 也加入了垂类大模型的战局,推出了 Bloomgberg GPT. 和 to C 场景不同,金融领域需要更高的准确性和可靠性,所以 Bloomberg GPT 在模型层数和参数量上会有明显增加,并采用混合精度的训练策略。

  4. ZMO.AI

    ZMO 自有的 6000 万高清营销照片数据集

诚然,Character.AI, 毫末智行,BloombergGPT 和 ZMO 都在验证一件事情,大模型终究是需要细分场景的数据和规则的,在特定场景中需要大量专门优化通用大模型来提升生成质量,并且符合这个专业场景的可控输入和输出才能真正的落地使用。

千“垂”百炼:垂直领域与语言模型

  1. 我不缺钱,我就是想把这种AI语言模型想尽办法和我的业务结合。我不管这种结合是真的契合还是勉强的。这样可以吗?

    可以,因为不缺钱,可以尽情的试错

    原因大概有2个:

    • 它很可能已经具备垂直领域的知识.这种AI模型是学习过海量资料的,无论你是在哪个垂直领域,它可能都有所涉及。它对于垂直领域的互动不见得会效果不好
    • 重的是它的某项技能。你可能也不需要这个AI模型学习过垂直领域相关的资料(换句话说,它即使不懂这个领域,同样可以帮助到你)。在这种情况下,取决于你看上了语言模型的哪些语言技能。比如,AI语言模型具有不错的文字总结能力,随便扔给它一篇业内的文章,虽然它可能看不太懂,但是它仍然可以总结出质量不错的简报。
  2. 我的垂直领域能接受语言模型的不完美吗?

    会犯错, 不确定性, 不方便“教训”, 不灵活, 带来额外支出(api bill) or 如果自己部署语言模型,需要购置能够运行语言模型的软硬件资源;拥有语言模型并不是全部,还是需要投入人力、财力、时间去打磨如何让模型与自己的业务相结合

  3. 我想把这种语言模型融入到自己的垂直领域,这到底是我无意识陷入了盲目跟随潮流,还是真的会对我的业务有帮助?

    对业务有无帮助看实际验证的效果,不凭空想象。如果找不到和自己业务类似的先例,这个问题的答案只有自己才能找到。

  4. 我不懂技术原理,如果我提出来一些天马行空、甚至不切实际、超出模型能力范围的想法,技术/研发人员会笑话我、反感我吗?

    垂直领域的落地正需要非技术和技术想法之间的碰撞, 从非技术人员的角度来看,我们需要他/她进行大胆、创新的业务规划。同时也需要技术人员对能够实现的功能进行评估(比如需要多少资源),对无法实现的业务功能及时提醒对方。

    从技术人员的角度看,我们同样可以为业务规划贡献想法。AI技术是不断发展的,以前很难实现、遥不可及的功能,在今天可能很容易就可以实现,但非技术人员可能没有及时的意识到这一点。这需要我们去提醒非技术人员,耐心的向他们科普目前技术能够做到哪些事情。

  5. 我听说做这个很烧钱,但是我没有那么多钱,我还有机会试一试吗?

    主要是借助现有经验或使用现有模型,不是从头创造。即使使用很小的模型(小模型的学习效率和知识储备能力不如大模型),经过恰当的训练(尤其根据人类的反馈),小模型是有机会与大模型的表现相媲美的(在垂直领域表现如何需要自行验证)

  6. 现有的可用语言模型很好,但是在我的领域表现还不够出色,我还是想要针对自己的领域研发一个模型。最应该注意什么?

    • 业务刚需还是为了华而不实的功能
    • 巧妇难为无米之炊,有无语言模型可用的学习数据
    • 在现有模型基础上继续研发是否合规

归根到底是可用的垂直领域数据

example:ChatDoctor:基于医学领域知识的LLaMA模型微调医学聊天模型

研究生第一学年奖学金评定的软件系统

怎么设计这个系统才能更好的平衡评奖过程中的公平效率

系统总体设计 – > 编造学生数据 —-> 程序实现

系统总体设计:

  1. 不能所有方面都混合计算
  2. 奖学金设计,复杂的话可以很复杂,但是抓住本质,抓住初心的话或许可以很简单
  3. 何为公平?信息公开,不忘初心就是公平
  4. 何为效率?去繁就简,不搞花里胡哨就是效率
  5. 绝对的量化效率高,但会出现制度漏洞,绝对的人来衡量会更加灵活公平,但是效率太低
  6. 学习成绩、科研成果、科创竞赛、民主评议、社会活动五个方面,重点放在科研成果和科创竞赛上,学习成绩不再作为评奖条件,学习成绩和民主评议仅作为所有奖项的门槛类条件,修改民主评议为分数制,而不是百分位制。
  7. 科研成果代表研究类,科创竞赛代表工程类
  8. 单项奖学金分为三类:学者、工程师、管理人员,这三类先按照量化积分排序,取前几名进行答辩,由专门老师进行打分
  9. 助学金刚入学就确定,其他奖学金到研一末研二初评选
  10. 国家奖学金由学者+工程师,两项量化积分平均取前几名进行答辩打分。
  11. 助学金调整:获得学者、工程师、管理人员或国家奖学金的可以升档,学习成绩不合格且民主评议不及格降为三档、学习成绩不合格或民主评议不及格降为二档。

算法设计思路(重点阐述)及实现。需要强调的是:在设计思路部分,请重点阐述模型库、数据库还有交互界面的基本框架。

答辩完成后请各位同学在7月24日中午12时之前将答辩ppt、系统程序源程序代码打包压缩以邮件的形式发送至Wanzheng_Liu6@163.com。过期不接受补交作业。请各位同学注意。有问题请及时沟通。